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The  purpose  of  this  study  was  to  assist  the  American  Forces  Press  and  Publications 
Service  (AFPPS)  in  ensuring  that  the  information  needs  of  its  DoD  audiences  are  being  met 
by  three  of  its  periodical  publications  entitled:  Defense  Magazine ,  Defense  Billboard ,  and 
Press  and  Art  Pack.  This  IDA  effort  was  undertaken  to  plan,  conduct,  and  analyze  surveys 
tailored  to  the  readerships  of  each  of  these  three  publications.  The  questionnaires  that 
evolved  from  our  information  requirements  analysis  elicited  responses  concerning  the 
format,  content,  and  availability  of  the  periodicals  which  will  be  used  to  enhance  the 
effectiveness  of  each. 

The  results  show  that  Defense  readers  today  are  less  positive  toward  the  magazine 
than  they  were  in  1986  with  fewer  readers  strongly  agreeing  that  Defense  presents  timely 
topics.  With  regard  to  the  Billboard  posters,  almost  60  percent  of  the  audience  reported 
recall  of  at  least  one  during  the  past  year.  Half  the  audience  saw  four  or  more  posters  and 
half  saw  fewer  than  four  posters.  About  one-third  recalled  seeing  1 1  of  the  12  posters  and 
no  one  recalled  seeing  all.  Press  and  Art  Pack  gets  its  highest  ratings  for  providing  copy 
that  is  the  appropriate  length  for  its  audience,  for  getting  its  product  to  editors  in  time,  for 
its  artwork,  and  for  its  production  tips. 

We  recommend  that  AFPPS  communicate  the  results  of  this  and  future  surveys  to 
their  editors  in  the  various  services.  This  communication  system  should  be  designed  to 
help  AFPPS  editors  and  distribution  executives  understand  which  of  their  market  segments 
are  most  likely  to  realize  enhancement  in  quality  of  life  and  performance  by  reading  AFPPS 
periodicals.  AFPPS  also  should  consider  establishing  a  regular  audience  survey  function 
to  feed  this  system  with  the  information  it  needs. 
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EXECUTIVE  SUMMARY 


A.  PURPOSE  AND  OBJECTIVES  OF  THE  STUDY 

The  purpose  of  this  study  was  to  assist  the  American  Forces  Press  and  Publications 
Service  in  ensuring  that  the  information  needs  of  its  DoD  audiences  are  being  met  by  three 
of  its  periodical  publications  entitled:  Defense  Magazine ,  Press  and  Art  Pack,  and  Defense 
Billboard.  This  Institute  for  Defense  Analyses  (IDA)  effort  was  undertaken  to  plan, 
conduct,  and  analyze  surveys  tailored  to  the  readerships  of  each  of  these  three  publications. 
The  questionnaires  that  evolved  from  our  information  requirements  analysis  elicited 
responses  concerning  the  format,  content,  and  availability  of  the  periodicals  which  will  be 
used  to  enhance  the  effectiveness  of  each. 

B.  BACKGROUND 

The  periodicals  being  assessed  in  this  study  are  edited  by  the  American  Forces 
Information  Service  (AFIS)  and  produced  by  its  American  Forces  Press  and  Publication 
Service  (AFPPS).  The  mission  of  AFIS  is  to  communicate  internal  information  about 
Department  of  Defense  policies  and  programs  to  the  military  and  civilian  audience 
worldwide  through  print  and  broadcast  media.  This  mission  is  accomplished  by  the 
implementation  of  some  25  information  objectives  established  by  AFIS  in  support  of 
Defense  Department  policy.  These  objectives  include:  American/military  heritage; 
citizenship/voting;  civilian  work  force;  conservation,  energy,  and  environment;  current 
events  and  the  military;  DoD  missions;  DoD  personnel  policies;  drug  and  alcohol  abuse; 
education  and  training;  guard  and  reserves;  health  and  medical  care;  military  balance/threat; 
military  benefits.  In  addition,  the  publications  also  emphasize  the  following  values: 
military  family/quality  of  life;  military  law;  operations  and  readiness;  overseas  service; 
personal  affairs;  research,  development,  and  acquisition;  retention;  safety;  security/law 
enforcement;  standards  of  conduct;  fraud,  waste,  and  mismanagement;  equal  employment 
opportunity. 

Defense  Magazine  is  one  of  the  means  for  communicating  these  information 
objectives  to  the  military  and  civilian  audience  and  is  the  most  comprehensive  of  the 


information  (13  percent  in  1989  versus  16  percent  in  1986  ),  and  less  likely  to  view  the 
magazine  as  particularly  relevant  to  their  duties  (5  percent  in  1989  versus  7  percent  in 
1986). 

The  1989  survey  also  provided  evaluations  of  the  individual  content  areas  of 
Defense  which  are  similar  to  those  results  obtained  in  1986.  The  magazine  still  gets  its  best 
marks  as  a  source  of  information  on  the  military  balance  and  Soviet  threat,  though  only 
18  percent  today,  compared  to  24  percent  in  1986,  consider  its  coverage  of  this  area  to  be 
"very  useful."  Overall,  75  percent  of  the  1989  audience  believes  the  amount  of  coverage 
devoted  to  threat  issues  should  remain  about  the  same.  The  1989  survey  showed  no  real 
differences  in  readers'  views  concerning  the  values  of  information  on  research  and 
development.  Guard  and  Reserve  affairs,  and  acquisition  and  procurement.  Most  readers 
(58  percent)  consider  the  coverage  on  Guard  and  Reserve  affairs  to  be  of  little  or  no  use. 
Increasing  the  coverage  of  manpower  and  personnel  issues  in  Defense  was  the  highest 
priority  recommendation  in  1986  and  this  area  remains  number  one  among  readers  in  1989. 
Readers  also  want  more  coverage  of  operations  and  readiness  and  research  and 
development,  which  were  priorities  in  1986  as  well.  However,  fewer  now  rate  Defense  as 
a  "very  useful"  source  of  information  on  manpower  and  personnel  issues,  operations,  and 
readiness.  Written  comments  received  from  several  respondents  discussed  the  issues  of  the 
magazine's  limited  distribution  and  suggested  altering  the  style  of  the  magazine  to  attract 
more  lower  ranking  individuals  who  may  benefit  from  its  content. 

b.  Recommendations 

We  recommend  that  die  editors  of  Defense  more  accurately  define  its  audience  and 
make  all  efforts  in  their  power  to  ensure  that  the  magazine  reaches  its  intended  audience 
through  the  mail/routing  system  (63  percent  get  it  through  the  mail/routing  system).  We 
recommend  AFIS  balance  the  ratio  of  audience  members  to  copies  by  increasing  the  print 
run  and  allocating  more  copies  to  the  Marine  Corps,  Navy  civilians,  and  Air  Force.  In 
addition,  AFIS  should  clearly  communicate  the  results  of  this  study  to  the  services  and  help 
the  services  understand  the  market  segments  most  likely  to  benefit  by  reading  Defense. 
AFIS  should  establish  an  ongoing  audience  feedback  system  to  determine  over  time  the 
effectiveness  of  changes  made  in  the  content  and  availability  of  Defense  in  response  to  the 
results  of  the  1989  survey.  This  feedback  system  could  be  based  on  a  "letters  to  the  editor" 
column  and  a  simple  "tear  out  and  return"  form  included  in  the  magazine  every  six  months. 
The  form  would  contain  simple  questions  to  which  the  audience  could  respond  with  their 
perceptions  of  the  effectiveness  of  any  changes  made  to  the  magazine. 
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2.  Billboard 


Forty-five  hundred  and  twenty-five  (4,525)  of  12,000  aimed  forces  personnel 
responded  to  our  August  1989  survey  questionnaire  for  a  return  rate  of  38  percent. 
Response  rates  were  highest  among  Air  Force  personnel  (42.3  percent)  and  lowest  among 
soldiers  in  the  Army  (33.2  percent).  Return  rates  were  highest  among  senior  NCOs 
(46.4  percent),  Field  grade  officers  (45.4  percent),  and  junior  enlisted  personnel 
(26.3  percent ). 

a.  Findings 

Almost  60  percent  of  the  audience  reported  recall  of  at  least  one  Billboard  poster 
during  the  past  year.  Half  the  audience  saw  4  or  more  posters  and  half  saw  fewer  than  4 
posters.  About  one- third  recalled  seeing  11  of  the  12  posters  and  no  one  recalled  seeing 
all.  The  most  memorable  poster  was  "Child  Abuse"  (45.5  percent  reported  recall)  and  the 
lowest  was  "Credit  Card  Debt"  (23  percent).  The  most  effective  poster,  "Don’t  Drink," 
was  given  a  rating  of  4.48  on  a  scale  of  1-5  and  the  least  effective,  again  "Credit  Card 
Debt,"  was  given  a  rating  of  3.62.  Even  the  least  effective  poster  was  rated  more  effective 
than  the  neutral  choice.  The  more  experienced,  educated,  and  higher  ranking  personnel 
were  less  inclined  to  rate  the  posters  as  effective.  While  three  out  of  four  respondents  said 
they  saw  the  posters  mostly  in  the  work  area.  Army  personnel  were  more  likely  than  others 
to  see  the  posters  in  the  barracks,  Navy  personnel  in  the  dining  area,  and  Air  Force 
personnel  in  the  library.  Several  respondents  included  suggestions  for  future  poster  topics 
in  the  areas  of  drug  and  alcohol  issues,  health  topics  and  personal  growth  and  career 
advancement  subjects.  Other  comments  suggested  widening  poster  distribution  and  display 
and  emphasizing  graphics  over  written  messages. 

b.  Recommendations 

In  order  to  increase  the  attractiveness  and  content  of  the  posters,  we  recommend 
that  AFIS  editors  continue  to  use  appropriate  media  channels  available  to  them  to  frequently 
disseminate  messages  that  reinforce  Billboard  themes.  This  recommendation  is  based  on 
"common  sense"  behavioral  modification  techniques,  rather  than  on  data  from  the  survey. 
AFIS  should  examine  the  market  segments  that  find  each  of  these  posters  especially 
effective  and  identify  other  sources  of  information  about  these  issues  from  which  these 
audience  segments  could  draw.  AFIS  should  institute  an  audience  feedback  function  that 
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focuses  attention  on  where  service  men  and  women  get  their  information  about  issues  that 
materially  affect  their  quality  of  life  and  effectiveness. 

3 .  The  Press  and  Art  Pack  (P&AP)  Survey 

Nine  hundred  twenty  one  (921)  of  the  1,500  editors  surveyed  in  August  1989 
responded  for  a  return  rate  of  61  percent  The  sample  includes  representatives  from  each 
uniform  service  and  DOD  agency/activity.  Most  are  from  the  Navy  (32  percent),  Army 
(31  percent)  and  Air  Force  (20  percent).  About  45  percent  of  the  respondents  are  active 
duty  military  personnel,  41  percent  civilian  employees  and  11  percent  are  National 
Guardsmen  or  Army  Reservists.  About  68  percent  of  the  editors  work  for  active 
component  organizations  and  20  percent  work  for  reserve  component  organizations.  The 
respondents  include  mostly  lower  ranking  enlisted  personnel  (E1-E6,  35  percent)  and 
civilians  in  pay  grades  GS  9  and  above  (33  percent).  About  12  percent  of  the  editors  are 
commissioned  officers  and  8  percent  are  senior  NCOs.  Six  of  the  editors  are  warrant 
officers. 

a.  Findings 

APIS  gets  its  highest  ratings  for  providing  copy  that  is  the  appropriate  length  for  its 
audience  (Q21),  for  getting  its  product  to  editors  in  time  for  them  to  use  it  (Q1 1  and  Q12), 
for  its  artwork  (Q23),  and  for  its  production  tips  (Q27).  Editors  are  discriminating  in  then- 
use  of  the  copy  and  art  work  included  in  Press  and  Art  Pack.  About  61  percent  indicate 
they  use  less  than  half  of  the  artwork  and  70  percent  say  that  they  use  less  than  half  of  the 
copy  included  in  each  mailing.  About  35  percent  indicate  they  never  use  the  halftone 
reproductions  included  in  the  package.  However,  about  49  percent  of  the  editors  want  the 
amount  of  artwork  increased.  The  areas  which  are  most  frequently  used  now  by  editors  are 
promotional/seasonal  art,  fitness  and  health,  and  sports/recreational  artwork. 

Frequency  of  publication  and  size  of  target  audience  are  more  important  than  the 
education  or  pay  grade  of  the  respondents  in  determining  how  much  art  they  use  (Q14). 
Editors  publishing  daily  make  the  least  use  of  the  art  services,  but  editors  publishing 
weekly  and  biweekly  report  the  greatest  amount  of  usage.  Usage  of  P&AP  art  is  more 
likely  by  editors  serving  small  target  audiences  with  the  highest  usage  rates  reported  by 
editors  serving  audiences  less  than  2,000,  from  2,000-5,000  and  from  5,001-15,000.  Our 
analysis  of  editors'  use  of  P&AP  copy  (Q15)  shows  that  only  pay  grade  and  publication 
frequency  influence  how  much  Press  and  Art  Pack  material  the  editors  use.  Enlisted 


military  and  civilian  editors  report  greater  usage  than  commissioned  editors.  Editors  of 
weekly,  daily,  and  biweekly  publications,  respectively,  make  more  frequent  use  of  the 
P&AP  editorial  packages.  The  least  amount  of  usage  is  reported  by  bimonthly  and 
quarterly  editors. 

Editors  are  most  pleased  with  the  amount  of  material  concerning  active  duty 
personnel  and  least  happy  with  the  coverage  of  Reserve  and  Guard  affairs.  About  two  in 
three  editors  want  a  change  here  and  most  of  them  want  less  material  pertaining  to  Guard 
and  Reserve  affairs.  Editors  also  want  less  information  aimed  at  retirees,  but  more  aimed  at 
civilian  employees.  The  standing  features  most  liked  by  editors  are  "Between  the  Lines," 
"National  Defense,"  and  "On  This  Date,"  respectively.  Several  editors  included  comments 
regarding  an  and  copy  provided  in  Press  and  An  Pack  and  its  distribution.  Many 
expressed  a  need  for  particular  types  of  art,  such  as  emblems  and  insignia,  and  requested 
earlier  distribution  of  seasonal  material. 

b.  Recommendations 

We  recommend  that  the  APIS  editors  carefully  examine  the  results  of  this  study 
pertaining  to  the  impact  of  frequency  of  publication  and  target  audience  size  on  utilization  of 
Press  and  Art  Pack  services.  These  factors  have  been  shown  to  influence  levels  of 
utilization  among  field  editors  and  we  believe  there  are  interservice  differences  in  these 
effects.  For  example.  Army  editors  apparently  publish  less  frequently  than  editors  from 
other  services  and  they  tend  to  serve  a  much  larger  audience.  Air  Force  editors  publish 
more  frequently  than  editors  from  the  other  services,  and  Navy  editors  are  serving  a 
significantly  smaller  target  audience.  AFIS  should  tailor  art  and  copy  materials  to  the  needs 
of  the  individual  services,  based  on  audience  size,  frequency  of  publication,  and  the 
characteristics  of  the  audiences  served  by  the  local  military  media. 

4 .  Overall  Recommendations 

Based  on  the  experience  gained  during  the  conduct  of  this  study,  we  recommend 
that  AFIS  establish  a  procedure  by  which  to  communicate  the  results  of  this  and  other 
surveys  to  their  editors  in  the  various  services.  This  system  should  be  designed  to  help 
AFIS  editors  and  distribution  executives  understand  which  of  their  market  segments  are 
most  likely  to  realize  enhancement  in  quality  of  life  and  performance  by  reading  AFIS 
periodicals.  AFIS  also  should  consider  establishing  an  ongoing  audience  feedback 
function  to  feed  this  system  with  the  information  it  needs.  This  feedback  function  could 
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have  two  components;  informal  "tear  out"  questionnaires  inserted  in  the  periodicals  every 
six  months  and  formal  surveys  conducted  every  three  years.  Both  of  these  media  would  be 
used  to  measure  the  effectiveness  of  audience  initiated  changes  made  in  the  periodicals.  We 
further  recommend  that  the  formal  survey  should  be  repeated  every  three  years,  and  that  the 
basic  content  of  the  survey  questionnaire  must  be  constant  from  year  to  year  to  allow 
comparisons.  However,  specialized  sections  may  be  added  as  new  questions  present 
themselves  for  evaluation.  In  addition  we  recommend  the  design  and  development  of  an 
audience  response  data  base  housed  within  AFIS,  but  accessible  to  all  interested  DoD 
editors  via  a  distributed  network. 

D.  THE  STRUCTURE  OF  THE  REPORT 

The  remainder  of  this  report  is  devoted  to  a  detailed  treatment  of  the  three  readership 
surveys  carried  out  for  AFIS  in  August  1989.  Each  survey  is  reported  in  an  independent 
document  so  that  AFIS  may  more  easily  distribute  the  results  to  those  concerned.  Chapter  I 
reports  on  the  Defense  Magazine  survey,  Chapter  II  describes  the  Billboard  poster  survey, 
and  Chapter  HI  discusses  the  Press  and  Art  Pack  survey.  Each  survey  report  follows  the 
same  format  which  is  standard  for  a  scientific  report  Each  begins  with  a  section  explaining 
the  background  and  purpose  of  the  effort  followed  by  a  section  describing  the  sampling 
procedures  and  questionnaire.  The  next  section  provides  a  discussion  of  the  results  and  is 
followed  by  the  conclusions  and  recommendations.  Each  chapter  is  illustrated  with  tables 
and  figures  which  graphically  present  the  quantitative  results  and  statistical  analyses 
performed  on  the  data.  Appendices  presenting  the  questionnaire  itself  and  the  descriptive 
statistics  for  all  information  items  are  included  for  each  survey.  The  report  ends  with  a 
summary  of  the  major  recommendations  derived  both  from  the  data  and  from  the 
experience  gained  during  administration  of  the  survey  effort 


L  THE  DEFENSE  MAGAZINE  SURVEY 


A.  BACKGROUND  AND  PURPOSE 

Defense  magazine  is  a  policy  oriented  publication  of  the  American  Forces 
Information  Service  (AFIS),  edited  and  produced  by  its  American  Forces  Press  and 
Publication  Service  (AFPPS).  The  mission  of  AFIS  is  to  communicate  internal  information 
about  Department  of  Defense  policies  and  programs  to  the  military  and  civilian  audience 
worldwide  through  print  and  broadcast  media.  Defense  is  one  of  the  print  media  products 
produced  by  AFPPS.  This  bimonthly  publication  is  targeted  to  senior  military  personnel 
and  civilian  employees  of  the  Department  of  Defense.  That  target  audience  is  defined  as 
senior  non-commissioned  officers  (E7  and  above),  warrant  officers,  field  grade  officers 
and  above,  and  civilian  employees  in  pay  grades  GS1 1  and  above. 

The  magazine  is  distributed  mainly  through  the  individual  service  publications 
distribution  systems,  in  which  bulk  shipments  are  made  to  selected  points  for  redistribution 
throughout  the  world.  During  calendar  year  1989,  the  standard  press  run  for  each  regular 
bi-monthly  issue  was  approximately  86,300  copies.  The  Army  received  approximately 
42,300  copies;  the  Navy,  13,500;  the  Air  Fence,  1 1,200;  the  Marine  Corps,  2,500;  and  the 
Coast  Guard,  3,000.  In  addition,  about  3,700  copies  were  distributed  to  intermediate  and 
senior-level  senior  service  colleges.  Smaller  shipments  are  made  to  Defense  agencies. 

AFIS  has  established  25  information  objectives  in  support  of  Defense  Department 
policy,  and  Defense  Magazine  is  one  means  by  which  those  objectives  are  implemented 
within  the  military  and  civilian  audience.  The  goal  of  Defense  Magazine  is  to  encourage  a 
positive  attitude  toward  the  following  values:  American/military  heritage;  citizenship/ 
voting;  civilian  work  force;  conservation,  energy  and  environment;  current  events  and  the 
military;  DoD  missions;  DoD  personnel  policies;  drug  and  alcohol  abuse  control;  education 
and  training;  guard  and  reserves;  health  and  medical  care;  military  balance/threat;  military 
benefits.  In  addition,  Defense  promotes:  military  family/quality  of  life;  military  law; 
operations  and  readiness;  overseas  service;  personal  affairs;  research,  development  and 
acquisition;  retention;  safety;  security/law  enforcement;  standards  of  conduct;  fraud,  waste 
and  mismanagement;  equal  employment  opportunity.  The  purpose  of  this  study  was  to 
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determine  whether  the  intended  audience  for  Defense  Magazine  is  receiving  the  publication, 
to  determine  what  the  audience  likes  and  dislikes  about  the  magazine,  and  to  determine 
what  they  believe  can  be  done  to  improve  it.  The  questionnaire  is  included  as  Appendix 
I-A,  and  descriptive  statistics  associated  with  each  information  item  are  contained  in 
Appendix  I-B. 

B .  SURVEY  PROCEDURES  AND  METHODS 

At  the  request  of  AFPPS,  the  Defense  Manpower  Data  Center  examined  the  March 
1989  manpower  data  base  to  identify  the  numbers  of  armed  forces'  personnel  in  the  target 
audience  (563,704  from  Table  1-19)  and  stratify  them  by  by  service  affiliation  and  location 
of  assignment  The  sample  size  requirements,  questionnaires  mailed,  actual  returns  and 
response  rates  are  shown  in  Table  1-1.  Our  goal  was  to  meet  5  percent  sampling  error 
requirements  for  each  cell  in  the  table  so  we  could  examine  differences  in  audience 
response  by  service  affiliation  and  pay  grade.  For  example,  we  want  estimates  of 
readership  for  senior  NCOs  in  the  Army  (E7-E9)  to  be  accurate  within  plus  or  minus  5 
percent  or  less.  In  order  to  do  so  we  required  a  total  of  3,748  returns  and  we  received 
4523  returns.  However,  419  of  those  responding  failed  to  answer  either  the  question  on 
pay  grade  or  the  one  concerning  service  affiliation  or  both.  This  reduced  the  usable  number 
of  respondents  (Table  1-1)  necessary  for  stratification  purposes  to  4,104.  Therefore,  we 
met  the  requirements  for  all  but  two  of  the  cells  in  Table  1-1.  We  fall  short  in  meeting  these 
requirements  for  civilians  in  pay  grades  GS/GM  1  l-12s  and  GS/GM  13-18  who  work  for 
the  Army,  Navy,  and  Marine  Corps.  Similarly,  all  other  analyses  are  based  on  the  full 
number  of  respondents  who  answered  the  question(s)  under  investigation. 

The  audience  selected  for  the  1989  survey  was  based  on  the  distribution  of  the  1986 
audience  who  reported  being  familiar  with  Defense  Magazine.  Only  those  who  indicated 
they  "never"  see  the  magazine  were  considered  unfamiliar  with  it  The  sampling  errors  for 
estimates  of  familiarity  in  the  1986  study  ranged  from  a  high  of  4.9  percent  (senior  Marine 
NCOs,  n  *  399)  to  a  low  of  4.1  percent  (GS12  and  above  in  the  Air  Force,  n  =  578).  A 
total  of  6,587  completed  questionnaires  (50.7  percent  response  rate)  were  returned  in  the 
1986  study.  Estimates  of  familiarity  for  the  1989  study  range  from  a  high  of  63.5  percent 
for  GS/GM  13-18  in  the  Army  to  a  low  of  44  percent  for  GS/GM  1 1-12  working  for  the 
Air  Force. 
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Table  M.  Sample  Size  Requirements  Versus  Actual  Returns  and 
Response  Rates  for  Defense  Magazine  1989  Survey* 


Army 

Navy 

Air 

Force 

Marine 

Corps 

Other 

DoD 

Totals 

E7-E9 

290 

266 

275 

150 

981 

312 

339 

391 

201 

1243 

33.62% 

39.79% 

44.43% 

41.79% 

39.57% 

928 

852 

880 

481 

3141 

W1-W4 

158 

46 

0 

27 

231 

169 

61 

0 

33 

263 

33.40% 

41.50% 

0.00% 

38.37% 

35.59% 

506 

147 

NA 

86 

739 

04-010 

228 

201 

246 

74 

749 

326 

273 

283 

97 

979 

44.66% 

42.46% 

35.91% 

40.93% 

40.83% 

730 

643 

788 

237 

2398 

GS/GM  11-12 

296 

291 

256 

35 

206 

1084 

229 

158 

227 

19 

315 

948 

24.16% 

16.95% 

27.68% 

16.96% 

47.73% 

27.30% 

948 

932 

820 

112 

660 

3472 

GS/GM  13-18 

209 

201 

163 

10 

120 

703 

202 

128 

180 

5 

156 

671 

30.19% 

19.91% 

34.48% 

15.63% 

40.63% 

29.82% 

669 

643 

522 

32 

384 

2250 

TOTALS 

1181 

1005 

940 

296 

326 

3748 

1238 

959 

1081 

355 

471 

4104 

32.74% 

29.81% 

35.91% 

37.45% 

45.11% 

34.20% 

3781 

3217 

3010 

948 

1044 

12000 

*  The  first  row  of  the  table  shows  the  required  sample  sizes  for  sampling  errors  of  5  percent  or  less  and  the 
second  row  shows  the  number  of  returns  from  respondents  with  those  attributes  implied  by  the  cells 
(e.g.,  Army  field  grade  officers).  The  response  rates  based  on  the  total  questionnaires  mailed  to 
respondents  with  these  attributes  (fourth  row)  are  shown  in  row  three.  So,  for  example,  we  mailed  669 
questionnaires  to  senior  dvifian  employees  (GS-GM  13-18)  of  the  Department  of  Army,  received  202  of 
them  back,  seven  short  of  our  target,  for  a  response  rate  of  30  percent. 
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At  the  request  of  AFPPS,  the  Defense  Manpower  Data  Center  generated  a  random 
probability  sample  corresponding  to  the  subsample  distribution  requirements  in  Table  1-1 
and  provided  mailing  labels  to  the  Allen  Division  of  CAE-Link  Corporation.  The 
questionnaire,  with  a  return  postage-paid  envelope,  and  cover  letter  from  the  Commander, 
Armed  Forces  Press  and  Publication  Service,  was  mailed  on  August  31  to  12,000 
uniformed  and  civilian  personnel  A  reminder  postcard  was  sent  10  days  later. 

C.  DISCUSSION  OF  THE  SURVEY  RESULTS 

The  results  of  the  Defense  Magazine  survey  are  summarized  below  and  treated  in 
detail  in  the  sections  which  follow. 


1 .  Overview 

Overall,  89  percent  of  the  respondents  gave  Defense  favorable  ratings,  i.e., 
21  percent  say  it  is  very  useful  and  68  percent  say  it  is  useful.  Approximately  three  in  four 
respondents  say  they  pass  along  copies  of  Defense  to  others.  Of  those  remaining, 
4  percent  keep  it,  6  percent  throw  it  out,  and  4  percent  pass  it  on  to  the  library.  Defense 
gets  good  marks  on  how  well  it  packages  content.  For  example,  compared  to  other  similar 
magazines.  Defense  is  judged  easy  to  read.  Eight  of  10  respondents  say  the  magazine  is 
easy  to  read;  12  percent  say  it  is  "very  easy"  to  read  while  only  5  percent  think  the 
magazine  is  difficult  to  read.  Respondents  say  the  list  of  major  topics  presented  on  the 
cover  of  the  magazine  is  "helpful”  (66  percent)  or  "very  helpful"  (1 1  percent)  in  planning 
what  they  read.  Three  of  four  believe  the  number  of  charts  and  graphs  in  Defense  should 
be  left  "the  same"  and  only  10  percent  would  either  increase  or  decrease  this  kind  of  an 
work.  On  the  other  hand,  36  percent  of  respondents  want  more  pictures  and  photographs 
in  the  magazine,  while  63  percent  are  content  with  the  number  of  pictures  and  photographs 
currently  carried  in  the  magazine. 

When  asked  about  some  general  uses  and  gratifications  associated  with  reading 
Defense ,  96  percent  of  the  respondents  agreed  that  the  magazine  presents  timely  topics  and 
92  percent  of  them  agreed  that  die  magazine  increases  their  knowledge  of  DoD  policies  and 
programs.  Furthermore,  74  percent  said  Defense  provides  information  and  perspectives  on 
DoD  policies  that  are  not  otherwise  available.  Consequently,  when  asked  to  rate  the 
usefulness  of  Defense  as  a  source  of  information  on  specific  issues  such  as  threat,  DoD 
manpower  and  personnel,  defense  missions,  and  research  and  development,  about 
80  percent  respondents  rate  the  magazine  in  the  useful  or  very  useful  categories.  About 
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58  percent  of  the  respondents  say  the  magazine  is  not  useful  for  information  on  Guard  and 
Reserve  affairs,  and  32  percent  say  the  magazine  is  not  useful  for  information  on 
acquisition  and  procurement  issues.  Overall,  54  percent  agree  the  magazine's  content  is 
particularly  relevant  to  their  duties. 

Finally,  when  asked  what  they  wanted  to  see  more  and  less  of  in  Defense , 
39  percent  wanted  more  emphasis  on  manpower  and  personnel  issues,  36  percent  wanted 
more  on  research  and  development,  33  percent  wanted  additional  information  on  operations 
and  readiness,  and  31  percent  wanted  to  know  more  about  defense  missions.  They  want 
less  on  the  Guard  and  Reserves  (32  percent  say  less  emphasis)  while  67  percent  of  the 
respondents  are  content  now  with  the  emphasis  put  on  the  Soviet  threat 

2 .  Service  Affiliation  and  Pay  Grade  Differences  in  Evaluation  of  Defense 

The  statistics  describing  the  responses  to  each  of  these  questions  in  measures  of 
central  tendency  and  dispersion  are  contained  in  Appendix  I-B.  We  examined  all  responses 
to  these  questions  while  controlling  for  service  affiliation  and  pay  grade.  The  differences  in 
evaluations  of  Defense  are  reported  in  this  section  fear  the  purpose  of  helping  AFIS  identify 
audience  segments  that  vary  from  the  audience  as  a  whole  in  their  perception  of  the 
magazine.  The  remainder  of  this  section  discusses  the  issues  of  exposure  to  and 
distribution  of  Defense  Magazine  and  audience  responses  to  its  content 

a.  Exposure  and  Distribution 

In  terms  of  service  affiliation,  35  percent  of  Air  Force  respondents  and  31  percent 
of  DoD  agency  respondents  have  never  seen  the  magazine  (see  Table  1-2).  When  we 
examine  pay  grade  differences  we  find  that  field  grade  officers  and  senior  civilian 
employees  are  much  more  likely  than  senior  NCOs  and  warrant  officers  to  see  the  magazine 
bimonthly  as  shown  in  Table  1-3.  On  the  other  hand,  more  senior  civilians  say  they  have 
never  seen  the  magazine  (33  percent)  than  say  they  see  it  bimonthly  (27  percent). 
Furthermore,  30  percent  of  the  senior  NCOs  who  responded  have  never  seen  the  magazine. 

Those  who  see  die  magazine  more  often  are  likely  to  receive  it  directly  through  the 
mail  or  the  routing  system.  The  field  grade  officers  and  senior  civilian  employees  are 
primary  target  audiences  for  the  magazine  and  proportionately  more  of  them  say  they  are 
getting  it  through  the  mail/routing  system,  as  shown  in  Table  1-4.  The  table  indicates  that 
the  distribution  system  is  certainly  working  for  the  field  grade  officers  with  more  than  three 
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Table  1-2.  Service  Affiliation  Dlfferencea  In  Exposure  to  Defense 


Exposure  (Q7) 

Almanac 


Service 

Never 

See 

Issue  Only 
or  Rarely 

Periodi- 

caBy 

Bi¬ 

monthly 

Total 

Army 

22.2% 

19.7% 

31.8% 

26.3% 

100% 

(222) 

(197) 

(318) 

(262) 

(999) 

Navy 

25.9% 

17.8% 

30.4% 

25.9% 

100% 

(205) 

(141) 

(241) 

(206) 

(793) 

Air  Force 

35.0% 

21.1% 

27.5% 

16.4% 

100% 

(297) 

(179) 

(233) 

(139) 

(848) 

Marines 

24.5% 

21.4% 

30.8% 

23.3% 

100% 

(81) 

(71) 

(102) 

(77) 

(331) 

DoD  Agency 

30.6% 

17.4% 

26.0% 

26.0% 

100% 

(60) 

(34) 

(51) 

(51) 

(196) 

TOTAL 

27.3% 

19.6% 

29.8% 

23.3% 

100% 

(865) 

(622) 

(945) 

(735) 

(3167) 

Chi-Square  -  61.97,  df  - 12,  p  <  0.01,  C  -  0.139 


Table  1-3.  Pay  Grade  Differences  In  Exposure  to  Defense 


Exposure  (Q7) 

Almanac 


Pay  Grade 

Never 

See 

Issue  Only 
or  Rarely 

Periodi- 

caOy 

Bi¬ 

monthly 

Total 

E7-E9 

30.1% 

19.4% 

32.5% 

18.0% 

100% 

(374) 

(241) 

(404) 

(223) 

(1242) 

W1-W4 

21.1% 

23.8% 

35.5% 

19.6% 

100% 

(56) 

(63) 

(94) 

(52) 

(265) 

04+ 

21.9% 

21.7% 

28.4% 

28.0% 

100% 

(222) 

(220) 

(288) 

(284) 

(1014) 

GS/GM  13-15,  SES 

32.6% 

(222) 

15.3% 

(104) 

25.1% 

(171) 

27.0% 

(185) 

100% 

(682) 

TOTAL 

27.3% 

(865) 

19.6% 

(622) 

29.8% 

(945) 

23.3% 

(735) 

100% 

(3167) 

Chi-Square  -  78.77,  df 

-9,  p<  0.01,  C  ■ 

0.155 

Table  1-4. 

Pay  Grade  Differences 

In  Distribution  Methods  of  Defense 

Distrftxjtion  (08) 

Pay  Grade 

Mail  Routing 
System 

Co-Worker 

Ubrary 

Total 

E7-E9 

63.2% 

28.8% 

8.0% 

100% 

(504) 

(230) 

(64) 

(798) 

W1-W4 

62.8% 

31.4% 

5.8% 

100% 

(118) 

(59) 

(11) 

(188) 

04+ 

77.7% 

16.0% 

6.3% 

100% 

(579) 

(119) 

(47) 

(745) 

GS/GM  13-15.  SES 

71.5% 

19.3% 

9.2% 

100% 

(334) 

(90) 

(43) 

(467) 

TOTAL 

69.8% 

(1535) 

22.7% 

(498) 

7.5% 

(165) 

100% 

(2198) 

Chi-Square  -  54.21.  df  -  6.  p  <  0.01.  C  -  0.155 
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in  four  saying  they  get  the  magazine  through  the  routing  system.  It  also  works  for  the 
civilian  employees,  si  least  among  those  who  report  seeing  the  magazine  (67  percent).  The 
beneficiaries  of  "passes  along"  are  primarily  the  senior  NCOs  and  warrant  officers  who  are 
much  more  likely  than  others  to  say  they  get  the  magazine  from  a  coworker. 

Table  1-5  shows  there  are  differences  across  the  services  in  extent  of  exposure 
within  the  various  ranks.  The  chi-square  statistic  used  in  this  and  other  tables  is  a  non- 
parametric  test  of  the  significance  of  differences  between  two  sets  of  frequencies.  It  is 
represented  by  the  ratio  of  the  observed  frequency  of  a  particular  occurrence  to  the 
frequency  expected  by  chance,  "p"  refers  to  the  probability  of  this  difference  occurring  by 
chance.  A  "p"  of  less  than  (<)  0.05  indicates  that  this  difference  occurs  fewer  than  5  times 
in  100  and  is  therefore  significant  by  statistical  convention.  Most  striking  here  is  that  Army 
NCOs  are  much  more  likely  to  be  regular  readers  than  are  senior  NCOs  from  the  other 
services.  Army  senior  civilian  employees  are  also  more  likely  to  be  regular  readers  than  are 

Table  1-5.  Pay  Grade  by  Service  Differences  in  Exposure  to  Defense 

Proportion  Saying  See 
Defense  (Q7) 

Service  Pay  Grade  Never  Bi-Monthly  Chi-Square 

(%)  (%)  Value  p 


Army 

(n  -  999) 

E7-E9 

W1-W4 

04+ 

GS/GM13-15.SES 

TOTALS 

19.6 

22.0 

21.4 

27.7 

22.2 

24.2 

16.7 

27.8 

34.6 

26.3 

34.51 

(df«9) 

<  0.001 

Navy 

E7-E9 

29.6 

18.8 

37.41 

<  0.001 

(n  -  793) 

W1-W4 

14.8 

27.8 

(df«9) 

04+ 

19.2 

36.1 

GS/GM13-15.SES 

35.7 

22.2 

TOTALS 

25.9 

26.0 

Air  Force 

E7-E9 

39.4 

10.3 

30.73 

<  0.001 

(n-848) 

04+ 

29.0 

19.0 

(df-6) 

GS/GM13-15.SES 

35.2 

25.1 

TOTALS 

35.0 

16.4 

* 
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their  counterparts  in  the  Navy  and  Air  Force.  Table  1-6  indicates  that  Army  E7-E9s  were  as 
likely  as  field  grade  officers  and  senior  civilian  employees  to  have  seen  the  latest  issue  of 
the  magazine  and  much  more  likely  than  others  to  recall  when  they  saw  the  last  issue. 
The  Navy  senior  NCOs  were  even  more  likely  than  the  civilians  to  have  seen  the  last  issue 
of  the  magazine.  Warrant  officers  were  much  less  likely  to  have  seen  the  magazine.  In 
Table  1-7  we  show  that  Army  warrant  officers  and  field  grade  Air  Force  officers  are  less 
likely  than  others  to  pass  the  magazine  on  to  others.  Air  Force  officers  are  more  likely  than 
others  to  throw  out  the  magazine. 


Table  1-6.  Pay  Grade  by  Service  Differences  in  Recall  of 
Most  Recent  Issue  Seen  (Defense) 


Proportion  Saying  See 
Defense  (09) 


Service 

Pay  Grade 

Don!  Remember 
(%) 

July-Aug  89* 
(%) 

Chi-Square 

Value  p 

Army 

E7-E9 

27.7 

31.3 

46.68 

<  0.001 

(n-781) 

W1-W4 

45.4 

16.7 

(df  - 18) 

04+ 

35.0 

34.7 

GS/GM 13-1 5.SES 

38.4 

34.9 

TOTALS 

35.1 

30.6 

Navy 

E7-E9 

36.0 

25.9 

34.43 

<  0.001 

(n  -  595) 

W1-W4 

39.2 

17.6 

(df  - 18) 

04+ 

42.8 

28.3 

GS/GM  13-1 5,SES 

42.2 

19.3 

TOTALS 

39.7 

25.2 

*  The  1989  Defense  Magazine  survey  questionnaire  was  mailed  August  31,  1989.  APIS  distributed  the 
July-August  issue  on  August  1.  So  the  July-August  issue  is  the  most  recent  issue  in  circulation  at  the 
time  of  our  survey. 
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Table  1*7.  Pay  Grade  by  Service  Differences  in  Disposition  of  Issues  of  Defense 


Proportion  Saying  See 
Defense  (Q10) 


Service 

Pay  Grade 

Pass  cxi  or  to  Ltorary 

(%) 

Throw  Out 
(%) 

Chi-Square 

Value  p 

Army 

E7-E9 

82.0 

7.7 

22.13 

<  0.036 

(n  -  720) 

W1-W4 

78.4 

8.5 

(df  - 12) 

04+ 

80.0 

7.4 

GS/GM13-15.SES 

80.5 

8.0 

TOTALS 

80.5 

8.0 

Air  Force 

E7-E9 

82.1 

5.7 

17.66 

<  0.024 

(n  -  496) 

04+ 

75.6 

10.6 

(df-8) 

GS/GM 13-1 5,SES 

86.5 

3.8 

TOTALS 

80.6 

7.1 

b.  Evaluations  of  Content  and  Content  Preferences 

Within  the  Army,  the  senior  NCOs  and  the  field  grade  officers  are  especially 
favorable  in  their  evaluations  of  the  magazine's  coverage  of  issues  related  to  the  military 
balance  between  East  and  West,  and  the  Soviet  threat  (Table  1-8).  Within  the  Army 
71  percent  of  the  senior  civilians  agree  that  Defense  is  particularly  relevant  to  their  duties, 
compared  to  55  percent  of  the  total  Army  sample,  and  55  percent  of  the  overall  sample. 
These  differences  are  reported  in  Table  1-9.  Within  the  Army,  the  senior  NCOs  and  the 
field  grade  officers  are  again  more  inclined  than  the  warrant  officers  and  civilians  to  regard 
the  coverage  of  Guard/Reserve  affairs  as  useful  (Table  1-10). 

There  are  other  major  differences  in  the  evaluations  by  military  and  civilian 
members  of  the  audience.  For  example,  senior  civilians  in  the  Army  are  much  more  likely 
than  other  members  of  that  service  to  rate  content  on  acquisitions  and  procurement  as  very 
useful.  In  this  group,  24  percent  rate  the  content  as  "very  useful"  compared  to  13  percent 
of  all  members  of  the  Army  audience  sample  (Table  1-1 1).  Senior  NCOs  in  the  Army  and 
Air  Force  want  mom  content  on  the  military  balance/Soviet  threat  than  do  other  members  of 
their  respective  service  (Table  1-12).  More  content  on  manpower  and  personnel  issues  is  a 
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Table  1-8.  Pay  Grade  by  Service  Differences  in  Perceptions  of  Usefulness  of 


Defense's  Content  on  Military 

Balance  and 

Soviet  Threat 

Service 

Pay  Grade 

Proportion  Saying  See 
Defense  (Q16a) 

Useful  Very  Useful 

(%)  (%) 

Chi-Square 

Value  p 

Army 

E7-E9 

56.7 

27.5 

24.43  <  0.004 

(n  -  631) 

W1-W4 

74.2 

14.8 

(df-9) 

04+ 

65.3 

21.5 

GS/GM13-15.SES 

62.5 

14.7 

TOTALS 

63.5 

21.0 

Table  1*9.  Pay  Grade  by  Service  Differences  In  Perceptions  of  Whether 
Defense's  Content  Is  Relevant  to  Duties 

Proportion  Saying  See 
Defense  (Qi5d) 

Service  Pay  Grade  Agree  Strongly  Agree  Chi-Square 

(%)  (%)  Value  p 


Army 

(n-411) 

E7-E9 

W1-W4 

04+ 

GS/GM1 3-1 5.SES 

TOTALS 

47.0 

42.6 

50.0 

63.3 

50.1 

3.8 

7.0 

4.6 

7.2 

5.3 

24.93  <  0.003 

(df-9) 

Table  1-10.  Pay  Grade  by  Service  Differences  In  Perceptions  of  Whether 
Defense' 8  Content  on  Guard  and  Reserves  Is  Useful 

Proportion  Saying  See 

Defense  (Ql6e) 

Service  Pay  Grade  Useful  Very  Useful  Chi-Square 

(%)  (%)  Value  p 

Army 

E7-E9 

46.6 

3.8 

26.10  <0.002 

(n  *  337) 

W1-W4 

37.8 

3.1 

(df-9) 

04+ 

48.1 

3.3 

GS/GM13-15.SES 

28.7 

2.2 

TOTALS 

42.3 

3.2 

Table  1*11.  Pay  Grade  by  Service  Differences  In  Perceptions  of  Whether 
Defense's  Content  on  Acquisitions  and  Procurement  Is  Useful 

Proportion  Saying  See 

Defense  (Q16g) 

Service  Pay  Grade  Useful  Very  Useful  Chi-Square 

(%)  (%)  Value  p 

• 

• 

• 

Army 

E7-E9 

54.2 

13.4 

34.64  <  0.001 

(n  -  520) 

W1-W4 

59.8 

9.4 

(df-9) 

04+ 

55.6 

9.5 

GS/GM13-15.SES 

58.0 

23.9 

TOTALS 

56.3 

13.4 

• 

Table 

I<12.  Pay  Grade  by  Service  Differences  In  Perceptions  of  Whether 

Defense’s  Content  on  Military  Balance/Soviet  Threat 

Should  Be  Expanded 

Proportion  Saying  See 

Defense  (Ql7a) 

Service 

Pay  Grade 

Less  Content 

More  Content 

Chi-Square 

• 

(%) 

(%) 

Value  p 

Army 

E7-E9 

2.9 

44.5 

31.03  <0.001 

(n-281) 

W1-W4 

4.7 

37.2 

(df-6) 

04+ 

5.0 

25.2 

• 

GS/GM13-15.SES 

8.0 

22.6 

Totals 

4.9 

33.0 

Air  Force 

E7-E9 

5.8 

30.9 

14.60  <  0.006 

• 

(n  - 149) 

04+ 

3.3 

20.8 

GS/GM13-15.SES 

6.4 

14.7 

TOTALS 

5.0 

23.9 

• 

• 

M2 

• 

top  priority  among  senior  NCOs  and  warrant  officers  in  the  Navy  (Table  1-13).  On  the 
other  hand,  field  grade  officers  in  the  Air  Force  want  more  coverage  of  operations/ 
readiness  issues  (Table  1-14).  Army  warrant  officers  and  senior  civilians  put  a  higher 
priority  on  research  and  development  topics  than  do  other  Army  audience  members 
(Table  1-15),  and  these  two  audience  segments  are  also  more  interested  than  others  in 
expanded  coverage  of  guard  and  reserves.  While  we  found  no  significant  differences  in  the 
ratings  of  Defense  Magazine's  current  coverage  of  Guard/Reserve  affairs,  we  do  find  that 
senior  NCOs  and  field  grade  officers  are  much  less  likely  than  are  warrant  officers  and 
civilians  to  want  the  coverage  decreased,  and  somewhat  more  likely  to  want  the  coverage 
increased  (Table  1-16).  Not  surprisingly,  we  found  that  the  senior  civilians  across  the 
services  were  most  interested  in  issues  relating  to  acquisition  and  procurement  (Table  1-17). 
Differences  regarding  other  aspects  of  these  questions  are  not  reported  since  they  were  not 
significant 

Table  1*13.  Pay  Grade  by  Service  Differences  In  Perceptions  of  Whether 
Defense’s  Content  on  Manpower/Personnel  Should  Be  Expanded 

Proportion  Saying  See 
Defense  (Q17b) 


Service 

Pay  Grade 

Less  Content 
(%) 

More  Content 
(%) 

Chi-Square 

Value  p 

Navy 

E7-E9 

6.1 

44.1 

19.98  <  0.003 

(n  -  266) 

W1-W4 

8.0 

56.0 

(df-6) 

04+ 

10.7 

28.6 

GS/GM13-15.SES 

11.1 

36.3 

TOTALS 

8.7 

38.4 

Table  1-14.  Pay  Grade  by  Service  Differences  In  Perceptions  of  Whether 
Defense’s  Content  on  Operations/Readiness  Should  Be  Expanded 

Service 

Pay  Grade 

Proportion  Saying  See 
Defense  (Ql7c) 

Less  Content  More  Content 
(%)  (%) 

Chi-Square 

Value  p 

Air  Force 

E7-E9 

4.5 

27.0 

10.50  <  0.033 

(n- 170) 

04+ 

3.2 

36.8 

(df-4) 

GS/GM13-15.SES 

3.6 

20.0 

TOTALS 

29.0 

Table  1-15.  Pay  Grade  by  Service  Differences  In  Perceptions  of  Whether 
Defense’s  Content  on  Research/Development  Should  Be  Expanded 


Proportion  Saying  See 
Defense  (Q17d) 


Service 

Pay  Grade 

Less  Content 

(%) 

More  Content 

(%) 

Chi-Square 
Value  p 

Army 

E7-E9 

9.0 

35.6 

38.19 

<  0.001 

(n«316) 

W1-W4 

3.9 

44.5 

(df  =  6) 

04+ 

14.2 

22.5 

GS/GM13-15.SES 

2.2 

43.4 

TOTALS 

8.5 

34.3 

Table  1-16.  Pay  Grade  by  Service  Differences  in  Perceptions  of  Whether 
Defense’s  Content  on  Guard/Reserves  Should  Be  Expanded 

Proportion  Saying  See 


Defense  (Ql7e) 


Service 

Pay  Grade 

Less  Content 

(%) 

More  Content 
(%) 

Chi-Square 
Value  p 

Army 

E7-E9 

20.7 

15.5 

30.06 

<  0.001 

(n-279) 

W1-W4 

36.8 

6.8 

(df«6) 

04+ 

17.0 

16.1 

GS/GM13-15 

35.6 

8.9 

TOTALS 

25.0 

13.3 

► 
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Table  1-17.  Pay  Grade  by  Service  Differences  In  Perceptions  of  Whether 
Defense's  Content  on  Acquisitions/Procurement  Should  Be  Expanded 

Proportion  Saying  See 
Defense  (Ql7g) 

Service  Pay  Grade  Less  Content  More  Content  Chi-Square 

(%)  (%)  Value  p 


Army 

(n  «  315) 

E7-E9 

W1-W4 

04+ 

GS/GM13-15 

TOTALS 

15.5 

13.5 

21.8 

3.6 

15.0 

24.0 

34.1 

21.3 

40.1 

27.9 

34.35 

(df-6) 

<  0.001 

Navy 

E7-E9 

16.7 

17.6 

18.26 

<  0.006 

(n  -  213) 

W1-W4 

8.5 

34.0 

(df«6) 

04+ 

17.6 

20.5 

GS/GM13-15 

10.3 

37.2 

TOTALS 

15.4 

22.8 

Air  Force 

E7-E9 

15.3 

20.3 

21.30 

<  0.001 

(n- 199) 

04+ 

15.8 

21.2 

(df-4) 

GS/GM13-15 

6.4 

40.9 

Totals 

13.6 

25.0 

3.  Comparisons  of  1989  and  1986  Audience  Studies 

The  1989  survey  for  Defense  is  comparable  to  the  worldwide  audience  study 
conducted  for  AFIS  in  1986  in  terms  of  the  sampling  plan,  the  questionnaire,  and  the 
means,  standard  deviations,  and  sampling  errors  of  estimate  for  pay  grade  and  service 
affiliation  as  shown  in  Table  1-18. 

The  1986  survey  includes  responses  from  6,587  members  of  the  audience.  Since 
Defense  Magazine  started  a  bimonthly  publication  cycle  (versus  monthly),  more  members 
of  the  1989  audience  reported  seeing  each  issue  (20  percent  in  1989  compared  to  14  percent 
in  1986).  This  may  be  misleading  since  when  one  combines  the  respondents  who  reported 
seeing  Defense  both  monthly  and  bimonthly  in  1986  (about  36  percent),  that  total  would  be 
greater  than  those  who  reported  seeing  the  magazine  bimonthly  in  1989  (27  percent). 
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Table  1-18.  Comparative  Statistics  Defense  Magazine 
1989  and  1986  Audience  Surveys 

1989  1986 


Question 

Response 

Cases 

Percent¬ 

age 

Cases 

Percent¬ 

age 

• 

Q7:  ‘...1  see  Defense 

Bi-Monthly 

901 

20.1 

903 

14.0 

Magazine... 

Never 

1524 

34.1 

2812 

44.0 

Q8:  *1  usually  receive 

Mail/ 

1890 

62.6 

2840 

72.0 

• 

Defense  Magazine... 

Routing  System 

Q10:  'My  copy  of  Defense 

Kept 

115 

4.0 

540 

15.0 

Magazine  is... 

Passed  Along 

2239 

77.1 

3100 

76.0 

or  Sent  to  Ubrary 

• 

Thrown  Out 

172 

5.9 

177 

4.0 

Q15:  *1  agree/disagree  that 

Defense  Magazine... 

a.  Presents  Timely  Topics 

Strongly  Agree 

454 

16.0 

703 

20.0 

• 

Mean:  3.12,  SD:0.45 

Mean:  3.17,  SD:  0.46 

b.  Helps  increase  my 

Strongly  Agree 

716 

25.0 

1015 

29.0 

knowledge  of  DoD 

policies/programs 

• 

Mean:  3.16,  SD:  0.59 

Mean:  3.23.  SD:  0.54 

c.  Gives  information  and 

Strongly  Agree 

364 

12.8 

572 

16.0 

perspectives  on  DoD 

policies  not  found 

elsewhere 

• 

Mean:  £87,  SD:  0.64 

Mean:  £94,  SD:  0.63 

d.  Is  particularly  relevant 

Strongly  Agree 

134 

4.7 

259 

7.0 

to  my  duties 

Mean:  £53,  SD:  0.69 

Mean:  £66,  SD:  0.66 

• 

(continued) 
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Table  1-18. 

(continued) 

Question 

Response 

1989 

Percent- 
Cases  age 

1986 

Percent- 
Cases  age 

Q16:  "1  find  Defense  Magazine, 
as  a  source  of  information 
in  each  of  the  following 
areas,  is... 

a.  Military  balance/ 

Soviet  threat 

Very  Useful 

500  17.7 

841  24.0 

Mean:  2.98,  SD:  0.65 

Mean:  3.10,  SD:0.63 

b.  DoO  manpower  and 

personnel  issues 

Very  Useful 

437  15.4 

638  18.0 

Mean:  2.92,  SD:  0.65 

Mean:  2.99,  SD.0.63 

c.  Operations  and 
readiness 

Very  Useful 

319  11.3 

483  14.0 

Mean:  2.87,  SD:  0.62 

Mean:  2.90,  SD:  0.63 

d.  Research  and 

development 

Very  Useful 

500  17.7 

647  18.0 

Mean:  2.93,  SD:  0.68 

Mean:  2.96.  SD:  0.67 

e.  Guard/Reserves 

Very  Useful 

103  3.7 

151  4.0 

Mean:  2.31,  SD:  0.76 

Mean:  Z45.  SD:  0.70 

f.  Defense  missions 

Very  Useful 

346  12.3 

548  16.0 

Mean:Z88,  SD:0.63 

Mean:  2.95,  SD:  0.63 

g.  Acquisition/ 

procurement 

Very  Useful 

363  12.9 

461  13.0 

Mean:  Z76,  SD:  0.73 

Mean:  2.78.  SD:  0.72 

Q18:  "1  beieve  that  Defense 
Magazine,  as  a  DoO 
policy  publication,  is... 

Very  Useful 

620  21.4 

949  26.0 
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On  the  positive  side,  fewer  today  say  they  never  see  the  magazine  (34  percent  in  1989 
versus  44  percent  in  1986),  and  about  the  same  proportion  (76  percent)  are  passing  the 
magazine  along  to  others  (see  Fig.  1-1).  Not  so  encouraging  is  the  fact  that  more  readers 
today  are  throwing  the  magazine  away  when  they  finish  and  fewer  are  keeping  it  than  in 
1986  (about  6  percent  throwing  it  away  and  4  percent  keeping  it,  versus  4  percent  in  1986 
who  were  throwing  it  away  and  15  percent  who  were  keeping  the  magazine). 

Overall,  Defense  Magazine  readers  today  are  somewhat  less  pleased  with  the 
magazine  than  they  were  in  1986.  The  differences  in  the  audience  evaluations  of  the 
magazine  between  the  two  surveys  are  modest,  but  important.  Now  that  the  magazine 
publishes  bimonthly,  fewer  readers  are  inclined  to  strongly  agree  that  Defense  presents 
timely  topics  (16  percent  in  1989  versus  20  percent  in  1986).  Readers  today  are  also 
somewhat  less  likely  to  strongly  agree  that  the  magazine  helps  increase  knowledge  of  DoD 
policies  and  programs  (25  percent  in  1989  versus  29  percent  in  1986),  less  likely  to 
consider  it  a  unique  source  of  information  (13  percent  in  1989  versus  16  percent  in  1986), 
and  less  likely  to  strongly  agree  that  the  magazine  is  particularly  relevant  to  their  duties 
(5  percent  in  1989  versus  7  percent  in  1986,  as  shown  in  Fig.  1-2). 

Readers  today  provide  very  similar  evaluations  of  the  content  areas  of  Defense  as 
they  did  in  1986.  The  magazine  still  gets  its  best  marks  as  a  source  of  information  on  the 
military  balance  and  Soviet  threat,  though  only  18  percent  today,  compared  to  24  percent  in 
1986,  consider  its  coverage  of  this  area  to  be  "very  useful."  Readers  still  rely  on  the 
magazine  for  information  on  manpower  and  personnel  issues,  for  information  on 
operations  and  readiness,  and  for  commentary  on  missions  assigned  to  the  armed  forces, 
but  somewhat  fewer  of  them  rate  Defense  as  a  "very  useful"  source  of  this  kind  of 
information.  There  are  no  significant  differences  between  the  1989  and  1986  ratings 
regarding  the  magazine's  usefulness  as  a  source  of  information  on  research  and 
development.  Guard  and  Reserve  affairs  or  acquisitions  and  procurement  (see  Figs.  1-3  and 
1-4),  although  most  readers  consider  the  content  on  Guard  and  Reserve  affairs  to  be  of  little 
or  no  use  (58  percent),  and  about  one  of  three  readers  would  actually  like  to  see  less 
content  on  Guard/Reserve  affairs.  The  senior  NCOs  and  field  grade  officers  in  the  Army 
are  much  less  likely  to  advocate  eliminating  articles  on  the  Guard/Reserves  and  are 
somewhat  more  likely  to  ask  for  more  articles  on  the  reserve  components.  Increasing  its 
coverage  of  manpower  and  personnel  issues  was  the  number  one  priority  in  1986  and  it 
remains  the  primary  area  of  interest  among  readers  in  1989.  Readers  also  want  more 
content  on  operations  and  readiness  and  on  research  and  development,  which  were  highly 
rated  in  1986  as  well. 


Percent 
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Figure  l-l.  Audience  Evaluatlone  of  Defense  Magazine- 
1986  and  1989  Samplee 
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Audience  Evaluations  of  Defense  Magazine- 
1986  and  1989  Samples 
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Percent 
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Figure  1-4.  Audience  Evaluations  of  Defense  Magazine- 
1986  and  1989  Samples 


It  is  important  to  note  that  many  of  the  differences  in  levels  of  exposure  to  Defense 
across  service  and  between  1986  and  1989  may  be  due  to  variance  in  the  ratios  of  audience 
members  to  copies.  To  represent  these  differences  in  exposure  or  availability  more  clearly, 
we  calculated  the  ratio  of  personnel  in  pay  grade  E-7  and  above,  including  warrant  officers 
and  civilians,  to  the  total  number  of  copies  allocated  to  each  service.  Overall  we  found  that 
there  are  now  7.52  people  for  each  copy  in  circulation,  versus  5.58  people  in  1986. 

The  Army  and  DoD  agency  audience,  which  receives  more  copies  than  the  other 
services,  is  not  reading  the  magazine  at  the  expected  levels  based  on  availability.  On  the 
other  hand,  the  Navy  audience  is  reading  above  its  level  of  expected  frequency.  For 
example,  in  the  1989  study,  26.3  percent  of  the  Army  audience  reports  seeing  the  magazine 
bimonthly,  compared  to  23.3  percent  of  the  overall  audience  (see  Table  1-19).  We  would 
expect  41  percent  of  the  audience  to  see  each  issue  because  the  Army  has  the  most 
favorable  ratio  of  audience  members  to  copies  in  circulation.  In  1986, 43  percent  of  the 
Army  audience  reported  seeing  the  magazine  monthly  or  bimonthly  (at  least  6  times  a  year), 
but  with  a  much  more  favorable  ratio  of  members  to  copies,  we  estimated  that  62  percent  of 
the  audience  would  have  seen  the  magazine  monthly  or  bimonthly.  The  Navy  audience  in 
1989,  on  the  other  hand,  with  1 1.70  members  per  copy,  is  a  much  more  active  readership. 
We  expected  17.1  percent  of  the  Navy  audience  to  see  the  magazine  bimonthly,  based  on 
their  less  favorable  ratio  of  members  to  copies,  but  29  percent  of  the  Navy  audience 
members  report  seeing  the  publication  bimonthly.  In  1986,  35.5  percent  of  the  Navy 
audience  reported  seeing  the  magazine  monthly  or  bimonthly,  though  we  expected  only  23 
percent  Even  though  the  Navy  audience  is  the  most  active  among  the  services  today,  it 
receives  a  disproportionately  smaller  allocation  of  copies  than  the  other  services.  The  ratios 
of  members  per  copy  calculated  in  1989  and  1986  for  each  of  the  audience  segments  are: 
Army,  4.88,  3.29;  DOD  Agencies/Activities  6.33,  6.33;  Marine  Corps  8.75,  8.32;  Navy 
11.70,  8.82;  and  Air  Force  12.79,  11.10  respectively.  In  Figs.  1-5  and  1-6  we  show  the 
generally  positive  relationship  between  favorable  "members  to  copies"  ratios  and  exposure 
levels. 

The  "audience"  used  to  estimate  exposure  is  commonly  defined  to  include  E7-E9s, 
warrant  officers,  commissioned  officers  04-010,  and  civilians  in  grades  GS  1 1  and  above. 
Actual  levels  of  exposure  here  are  based  on  the  upper  limits  of  the  95  percent  confidence 
interval  estimates  from  the  1989  and  1986  samples.  Our  1989  estimates  are  that  between 
1 15,488  and  149,849  audience  members  are  seeing  the  magazine  each  issue,  indicating  that 
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Table  1*19.  Population  Estimates  of  Exposure  to  Defense  Magazine, 

1989  and  1986 


Defense  Magazine  Exposure  1989 


A 

B 

C 

D 

E 

F 

G 

Army 

23.5% 

29.0% 

206321 

48485 

59833 

42300 

4.88 

DoD 

19.9% 

32.2% 

34401 

6846 

11077 

5432 

6.33 

Marines 

18.7% 

27.8% 

21867 

4089 

6079 

2500 

8.75 

Navy 

22.9% 

29.0% 

157915 

36163 

45795 

13500 

11.70 

Air  Force 

13.9% 

18.9% 

143200 

19905 

27065 

11200 

12.79 

Totals 

20.5% 

26.6% 

563704 

115488 

149849 

74932 

7.52 

Defense  Magazine  Exposure  1986 

A 

B 

C 

D 

E 

F 

G 

Army 

37.6% 

43.1% 

164700 

61845 

70903 

50000 

3.29 

DoD 

19.9% 

32.2% 

34401 

6846 

11077 

5432 

6.33 

Marines 

32.4% 

41.5% 

20810 

6732 

8628 

2500 

8.32 

Navy 

29.4% 

35.5% 

113737 

33382 

40320 

12900 

8.82 

Ah’ Force 

23.9% 

28.9% 

124298 

29658 

35872 

11200 

11.10 

Totals 

30.2% 

36.4% 

457946 

138462 

166800 

82032 

5.58 

*  Columns  A  and  B  are  tha  lower  and  upper  limits  of  the  95%  confidence  intervals  for  estimates  of  the 
proportion  of  the  total  Defense  audience  seeing  the  journal  bimonthly.  Column  C  is  the  size  of  the 
audience  for  each  service.  Columns  D  and  E  apply  proportions  A  and  B  to  the  size  of  the  audiences  (C) 
in  each  service.  Column  F  is  the  number  of  copies  of  the  magazine  the  service  gets  each  month.  Column 
G  is  a  ratio  of  members  (column  C)  to  copies  in  circulation  (column  F). 
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Exposure  ’89  ■■  Members  Per  Copy  ’89 
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Figure  1-5.  Defense  Magazine  1989  and  1986- 
Bimonthly  Exposure/Members  Per  Copy 


Audience  Size  ’89  feU  Members  Per  Copy  '89 
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Figure  1-6.  Defense  Magazine  1989  and  1986- 
Bimonthly  Exposure/Members  Per  Copy 


each  copy  is  passed  onto  one  other  person  (2.00  readers  per  copy).  Our  1986  estimates 
were  that  between  138,462  and  166,800  audience  members  were  seeing  the  magazine  each 
month  or  bi-monthly,  indicating  a  somewhat  higher  2.03  readers  for  each  copy  in 
circulation.  Other  expected  levels  of  exposure  for  various  DoD  audiences  are  reported  in 
Table  1-19. 

4.  Defense  Comments  Analysis 

A  total  of  278  individuals  provided  written  comments  in  response  to  survey 
Item  19.  A  breakdown  of  comments  by  service  affiliation  and  pay  grade  is  provided  in 
Table  1-20.  Individuals  affiliated  with  the  Army  provided  the  highest  number  of  comments 
(n  «  71,  27  percent),  followed  by  the  Air  Force  (n  =  61,  23  percent).  Navy  (n  =  56,  21 
percent),  and  Marines  (n  =  23,  9  percent).  Fifty-one  (51,  19  percent)  respondents 
indicated  affiliation  with  some  other  DoD  agency.  The  highest  return  rate  among  all  pay 
grades  was  received  for  GS1-GS12  level  civilians  (n  =  80, 30  percent). 

The  individual  responses  to  question  19  are  presented  in  Appendix  I-C  were  they 
were  organized  into  broad  categories  describing  the  general  nature  of  the  responses.  The 
categories  addressed  areas  regarding  distribution,  style  of  the  magazine,  content  of  articles, 
and  overall  opinions.  Table  1-21  provides  the  frequency  of  comments  for  each  category. 

The  type  of  responses  most  frequently  received  concerned  the  distribution  of 
Defense  (n  =  83),  and  its  perceived  effectiveness  and  value  as  an  information  source 
(n  =  59).  Several  respondents  indicated  that  they  had  never  seen  Defense  Magazine 
(n  =  56)  or  had  not  seen  it  for  some  time  (n  =  28). 

The  most  frequent  comments  within  the  category  of  distribution  referred  to  the  poor 
distribution  of  Defense  (n  =  12),  while  others  offered  suggestions  to  increase  the  number 
of  magazines  sent  to  all  levels  and  to  circulate  the  publication  through  work  areas. 
Comments  regarding  the  style  of  presentation  employed  by  the  magazine  noted  that  articles 
are  often  written  above  the  comprehension  level  of  staff  or  lower  ranks  who  might  find 
Defense  a  valuable  source  of  information.  Those  commenting  on  the  content  of  Defense 
expressed  the  desire  to  see  more  pictures,  graphs,  and  photographs,  and  addressed  a 
variety  of  other  topics  such  as  procurement,  legislative  issues,  and  comparisons  between 
old  and  new  DoD  policy.  Those  providing  general  opinions  about  Defense  expressed  a 
variety  of  sentiments.  While  some  found  the  articles  one-sided,  and  felt  the  material  was 
not  applicable  to  their  duties,  others  perceived  Defense  as  a  valuable  reference  source. 
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Table  1*20.  Frequency  of  Defense  Comments  Received 
by  Pay  Grade  and  Service  Affiliation 


Pay  Grade 

Army 

Navy 

Air  Force 

Marines 

DoD 

Other 

Total 

E1-E6 

1 

1 

0.4 

E7-E9 

18 

15 

20 

14 

2 

69 

• 

26.0 

W1-W4 

12 

2 

1 

1 

16 

6.0 

01-03 

1 

1 

• 

0.4 

04-06 

10 

15 

13 

8 

4 

50 

18.9 

GS1-GS12 

20 

13 

12 

1 

33 

1 

80 

30.2 

i 

GS/GM13- 

9 

8 

11 

7 

35 

GS/GM15 

13.2 

Other 

2 

2 

4 

4 

1 

13 

4.90 

# 

TOTAL 

71 

56 

61 

23 

51 

3 

265 

26.8 

21.1 

23.0 

8.7 

19.2 

1.1 

100.0 

Table  1*21.  Defense  Comments,  Frequency  of  Responses 
Within  General  Categories 


Category 

Frequency 

Distribution 

73 

Opinion 

55 

Content 

34 

Style 

22 

Other 

115 
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The  overall  nature  of  the  comments  on  Defense  Magazine  indicate  that  distribution 
may  be  a  problem  area,  since  many  members  of  the  target  audience  are  not  receiving  or 
seeing  the  magazine.  Those  who  are  exposed  to  Defense  would  like  to  see  the  writing  style 
altered  to  widen  the  magazine's  appeal  to  lower  ranking  personnel,  and  request  that  AFPPS 
increase  the  use  of  graphs,  photographs,  and  pictures.  The  comments  are  generally 
helpful,  offering  AFPPS  suggestions  to  increase  the  magazine's  exposure,  as  well  as  ideas 
for  future  articles. 

D.  CONCLUSIONS  AND  RECOMMENDATIONS 

Senior  military  and  civilian  members  of  the  audience  (e.g.,  field  grade  officers  and 
GS  13-15)  are  more  likely  to  see  Defense  on  a  consistent  basis,  and  the  senior  civilian 
employees  are  more  likely  than  other  members  of  the  audience  to  give  Defense  high 
usefulness  ratings.  Army  and  Marine  Corps  personnel  are  more  likely  to  see  Defense  on  a 
periodic  basis.  Members  of  the  Air  Force  and  those  working  for  DoD  agencies/activities 
are  less  likely  to  see  it  periodically.  When  we  look  at  just  the  proportion  of  audience 
members  from  the  various  services  who  see  each  issue  of  the  magazine  bimonthly,  we  see 
that  audience  members  from  DoD  agencies,  the  Army,  and  Navy  are  the  most  likely  to  see 
Defense  bimonthly.  Army  personnel  provide  higher  evaluations,  and  Navy  personnel 
lower  evaluations  of  Defense  than  do  personnel  affiliated  with  the  other  services.  More 
members  of  the  audience  today  compared  to  1986  are  seeing  Defense  and  more  are  seeing  it 
on  a  regular  basis. 

Defense  is  considered  easy  to  read  by  enlisted,  officer,  and  civilian  members  of  the 
audience.  The  average  rating  is  3.07  on  a  scale  ranging  from  1  =  very  difficult  to  4  =  very 
easy.  However,  even  though  readers  find  the  magazine  easy  to  read,  they  do  not  find  it 
quite  as  useful  today  as  they  reported  in  1986.  Our  analysis  shows  three  factors  are 
strongly  associated  with  positive  evaluations  of  the  magazine:  (1)  frequency  of  exposure  to 
the  magazine;  (2)  belief  in  the  magazine  as  policy-oriented  publication;  and  (3)  pay  grade. 
Audience  members  who  see  the  magazine  on  a  consistent  basis  give  it  high  ratings. 
Readers  who  believe  the  magazine  should  be  focusing  on  policy  issues  give  it  higher 
ratings  as  a  source  of  timely,  duty-relevant  policy  information  (see  Figs.  1-1  and  1-2). 
General  officers,  GS  13-15  employees,  and  field  grade  officers  give  the  magazine  more 
favorable  evaluations.  Although  these  results  are  interesting,  it  should  be  noted  that  the 
varying  ratios  of  audience  members  to  copies  of  Defense  across  the  Services  and  from 
1986  to  1989,  reported  earlier,  may  be  the  most  influential  determinant  of  effectiveness. 
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Consequently,  the  editors  of  Defense  should  define  its  audience  more  accurately 
and  continue  to  make  all  efforts  in  their  power  to  ensure  that  the  magazine  reaches  its 
intended  audience  through  the  mail/routing  system  (63  percent  get  it  through  the 
mail/routing  system).  The  effectiveness  of  the  distribution  systems  used  by  the  respective 
services  has  not  been  addressed  in  this  report  and  should  be  the  subject  of  further  studies. 
In  addition,  the  IDA  study  team  recommends  that  AFIS  balance  the  ratio  of  audience 
members  to  copies,  either  by  increasing  the  print  run  and  allocating  more  copies  to  the 
Marine  Corps,  Navy  civilians,  and  Air  Force.  Another  strategy  would  be  to  increase  the 
number  of  copies  and  allocate  them  to  the  Navy  civilians,  where  return  rates  were  lower 
than  expected.  Examination  of  the  written  comments  provided  by  several  respondents 
indicated  the  need  for  a  change  in  the  distribution  of  Defense.  Several  respondents 
requested  that  their  names  be  added  to  the  Defense  mailing  list  The  names  and  addresses 
of  these  respondents  are  included  as  Appendix  I-D. 

AFIS  should  communicate  the  results  of  this  study  to  the  services  and  help  them 
understand  which  of  their  market  segments  are  most  likely  to  be  gratified  by  reading 
Defense.  AFIS  also  should  consider  establishing  an  ongoing  audience  feedback  system  to 
determine  over  time  the  effectiveness  of  changes  it  makes  in  response  to  this  and  future 
surveys. 
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n.  THE  BILLBOARD  POSTER  SURVEY 


A.  BACKGROUND  AND  PURPOSE 

The  Defense  Billboard  is  the  poster  periodical  of  the  American  Forces  Information 
Service  (APIS),  designed  and  produced  by  its  American  Forces  Press  and  Publication 
Service  (AFPPS).  The  mission  of  APIS  is  to  communicate  internal  information  about 
Department  of  Defense  policies  and  programs  to  the  military  and  civilian  audience 
worldwide  through  print  and  broadcast  media.  The  Billboard  poster  is  the  APIS 
publication  oriented  toward  a  young  enlisted  man  or  woman's  health,  safety,  and  welfare. 
The  monthly  Billboard  poster  is  targeted  to  first  rime  enlisted  military  personnel  and  junior 
level  civilian  employees  of  the  Department  of  Defense. 

APIS  has  established  25  information  objectives  in  support  of  Defense  Department 
policy,  and  Billboard  is  one  means  by  which  that  information  is  communicated  to  the 
military  and  civilian  audience.  The  goal  of  Billboard  is  to  encourage  a  positive  attitude 
among  its  audience  members  toward  the  following  values:  American/military  heritage; 
citizenship/voting;  civilian  work  force;  conservation,  energy  and  environment;  current 
events  and  the  military;  DoD  missions;  DoD  personnel  policies;  drug  and  alcohol  abuse 
control;  education  and  training;  guard  and  reserves;  health  and  medical  care;  military 
balance/threat;  military  benefits.  In  addition.  Billboard  promotes:  military  family/quality  of 
life;  military  law;  operations  and  readiness;  overseas  service;  personal  affairs;  research, 
development,  and  acquisition;  retention;  safety;  security/law  enforcement;  standards  of 
conduct;  fraud,  waste,  and  mismanagement;  equal  employment  opportunity. 

The  purpose  of  this  survey  was  to  determine  whether  the  intended  audience  for 
Billboard  recalled  seeing  the  posters,  whether  the  posters  are  considered  effective  in 
delivering  their  message,  and  what  topics,  if  any,  the  audience  believed  should  be  featured 
in  Billboard  posters  to  come.  Respondents  were  provided  with  a  questionnaire  and  a  full 
color  foldout  "broadsheet"  that  presented  billfold-size  facsimiles  of  the  12  posters 
distributed  during  the  past  year.  The  respondents  woe  asked  if  they  recalled  seeing  die 
posters  and  were  then  asked  to  evaluate  the  effectiveness  of  each.  Fixed-response 
alternatives  included  "Very  effectively,"  "effectively,"  "ineffectively,"  "very  ineffectively," 
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or  "I  do  not  recall  seeing  the  poster."  The  questionnaire  is  included  as  Appendix  II- A,  and 
Appendix  II-B  shows  responses  to  each  question  together  with  a  descriptive  statistical 
summary. 

B .  SAMPLING  PROCEDURES  AND  METHODS 

At  the  request  of  AFPPS,  the  Defense  Manpower  Data  Center  examined  the  March 
1989  manpower  data  to  identify  the  numbers  of  armed  forces  personnel  in  the  target 
audience  and  to  stratify  them  by  service  affiliation  and  pay  grade.  We  chose  to  sample 
uniform  personnel  only,  because  the  posters  are  displayed  primarily  in  areas  where  military 
personnel  work,  sleep,  eat,  or  relax.  The  sample  size  requirements,  actual  numbers  of 
returns  and  response  rates  are  shown  in  Table  II-l. 

Sample  size  requirements  were  based  on  a  sampling  error  goal  of  5  percent  or  less 
(95  percent  confidence)  within  each  cell.  Therefore,  our  sampling  plan  required  4,321 
respondents,  and  we  received  4525  total  returns  for  a  37  percent  return  rate.  However,  96 
of  those  responding  failed  to  answer  either  the  question  on  pay  grade  or  the  one  concerning 
service  affiliation  or  both.  This  reduced  the  usable  number  of  respondents  necessary  for 
stratification  purposes  to  4,429  (Table  II-l).  Therefore,  we  fall  short  in  meeting  these 
requirements  for  only  three  cells  representing  senior  civilians  who  work  for  the  Army, 
Navy,  and  Marine  Corps. 

Estimates  of  the  extent  to  which  these  audience  subsamples  are  familiar  with 
Billboard  were  based  on  the  1986  worldwide  audience  survey  and  other  studies  for  Army 
Reserve  Magazine  and  Stars  and  Stripes.  Our  estimates  of  familiarity  for  the  1989 
Billboard  study  range  from  a  high  of  57  percent  for  Army  senior  NCOs  and  officers  to  a 
low  of  40  percent  for  E3-E6s  in  the  Army,  Navy,  and  Air  Force. 

To  access  this  audience,  the  Defense  Manpower  Data  Center  generated  a  random 
probability  sample  corresponding  to  the  sample  distribution  requirements  in  Table  II-l  and 
provided  mailing  labels  to  the  Allen  Division  of  CAE-Link  Corporation.  The  questionnaire 
and  facsimiles  of  the  12  posters,  with  return  postage-paid  envelope,  and  cover  letter  from 
the  Commander,  Armed  Forces  Press  and  Publication  Service,  were  mailed  between 
August  25  and  September  8  to  12,000  uniformed  personnel.  A  reminder  postcard  was  sent 
10  days  later. 
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Table  IM.  Sample  Size  Requlremema  Versus  Actual  Returns 
and  Response  Rates  for  Billboard  1989  Study* 


Army 

Navy 

Air 

Force 

Marine 

Corps 

Totals 

E3-E6 

354 

350 

350 

320 

1374 

215 

335 

411 

236 

1197 

18.49% 

29.03% 

35.62% 

21.87% 

26.31% 

1163 

1154 

1154 

1079 

4550 

E7-E9 

290 

266 

275 

150 

981 

356 

397 

423 

265 

1441 

40.92% 

48.36% 

52.42% 

43.80% 

46.44% 

870 

821 

807 

605 

3103 

W1-W4 

158 

46 

0 

27 

231 

125 

51 

0 

22 

198 

39.56% 

55.43% 

0 

40.74% 

42.86% 

316 

92 

NA 

54 

462 

01-03 

281 

261 

295 

149 

986 

269 

233 

313 

135 

950 

38.26% 

35.68% 

42.41% 

36.19% 

38.51% 

703 

653 

738 

373 

2467 

04-010 

228 

201 

246 

74 

749 

186 

195 

195 

67 

643 

44.82% 

53.42% 

41.14% 

40.85% 

45.35% 

415 

365 

474 

164 

1418 

TOTALS 

1311 

1124 

1166 

720 

4321 

1151 

1211 

1342 

725 

4429 

33.20% 

39.25% 

42.29% 

31.87% 

36.91% 

3467 

3085 

3173 

2275 

12000 

*  Return  rates  for  the  category  of  E3-E6  are  not  precisely  correct  because  these  numbers  reflect  returns 
from  E1-E4s,  one  of  the  grade  categories  on  the  questionnaire.  The  sampling  plan  called  only  for  E3- 
E6s.  The  sample  size  requirements  for  sampling  errors  equal  to  or  less  than  5  percent  are  reflected  in 
the  first  row  of  the  table,  the  actual  number  of  returns  from  each  grade  and  service  category  is  reflected 
in  the  second  row.  The  third  row  shows  the  response  rates  baaed  on  the  number  of  questionnaires 
maffed  to  respondents  (shown  in  row  four)  with  the  attributes  implied  by  the  cell.  Example:  the  column 
marginals  overal  indicate  we  required  a  total  of  4,321  returns.  We  received  4,429,  or  37  percent  of  the 
number  mailed  (12,000). 
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The  return  rates  for  the  survey  ranged  from  a  high  of  42  percent  by  the  Air  Force  to 
a  low  of  33  percent  by  the  Army.  Return  rates  by  pay  grade  ranged  from  a  high  of 
46  percent  by  senior  NCOs  to  a  low  of  26  percent  by  junior  enlisted  personnel.  As  a 
result,  our  sample  somewhat  under-represents  junior  NCOs  in  each  of  the  services  except 
the  Air  Force,  warrant  officers  in  the  Army  and  Marine  Corps,  company  grade  officers  in 
each  of  the  services  except  the  Air  Force,  and  field  grade  officers  in  each  of  the  services. 
We  also  received  fewer  responses  than  expected  from  the  Army  as  a  whole.  Due  to  this 
under-representation,  estimates  of  recall  and  effectiveness  based  on  these  particular  pay 
grade  and  service  subsamples  may  have  sampling  errors  as  high  as  9  percent  Therefore, 
inferences  drawn  from  these  subsamples  must  be  viewed  with  caution  since  the  probability 
that  these  conclusions  may  be  due  to  chance  is  almost  twice  as  great  as  scientific  convention 
requires  (i.e.,  S  percent).  However,  estimates  of  recall  and  effectiveness  for  the  entire 
audience  are  accurate  within  a  sampling  error  of  l.S  percent  and  therefore  accurately 
represent  the  population  from  which  they  were  drawn.  All  other  analyses  are  based  on  the 
full  number  of  respondents  who  answered  the  question(s)  under  investigation. 

C.  DISCUSSION  OF  THE  RESULTS 

The  results  of  the  Billboard  survey  are  summarized  below  and  treated  in  detail  in  the 
sections  which  follow. 

1 .  Overview 

Respondents  were  asked  in  Q8  to  indicate  whether  or  not  they  recalled  seeing  each 
poster.  In  Q10  they  were  asked  to  rate  the  effectiveness  of  each  poster  whether  or  not  they 
recalled  seeing  it.  Q10  also  asked  if  they  recalled  seeing  the  poster  in  order  to  measure 
consistency  of  recall  Almost  60  percent  of  die  audience  reports  some  recall  of  at  least  one 
of  the  12  Billboard  posters  distributed  during  the  past  year.  In  order  to  clearly  present 
recall  data,  we  chose  to  calculate  the  following  ratios.  We  first  assigned  each  respondent  a 
value  between  1  and  12  indicating  how  many  of  the  posters  he  or  she  recalled  seeing.  We 
then  tabulated  the  total  number  of  respondents  seeing  1, 2, 3, 4...n  posters,  and  established 
a  distribution  of  recall  scores  for  the  entire  sample  of  respondents.  We  found  that  half  the 
audience  members  saw  4  or  more  posters,  half  saw  fewer  than  4  posters,  and  about  one- 
third  of  the  audience  recalled  seeing  1 1  of  the  12  posters.  No  one  in  our  sample  recalled 
seeing  all  12  posters. 
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We  then  considered  the  effectiveness  ratings  of  just  those  who  recalled  seeing  the 
posters  (Q10).  These  average  ratings  are  presented  in  brackets  below.  The  posters  are 
presented  from  most  to  least  recall  which  is  determined  by  averaging  the  proportion  of 
respondents  indicating  "recall"  to  questions  8  and  10.  The  number  of  positive  responses  to 
Question  8  ranges  from  a  high  of  4,444  to  the  "Esprit"  poster  to  a  low  of  4,406  to  the 
"AIDS"  poster.  The  number  of  respondents  to  Question  10  who  say  they  recall  the  poster 
and  who  rate  the  poster's  effectiveness  ranges  from  a  high  of  2,516  for  the  "Child  Abuse" 
poster  to  a  low  of  1,727  for  the  "Credit  Card  Debt"  poster.  The  effectiveness  scale  ranges 
from  1  =  No  Recall  to  5  =  Very  Effective. 


Recall  Effectiveness 

Poster  Number  Proportion  (1  =  No  Recall.. .5  =  Very  Eff) 


n 

Mean 

4. 

Child  Abuse 
["Sometimes  the  Hun  Is 

More  Than  Skin  Deep”] 

\ 

45.5% 

2516 

2.98 

[4.39] 

1. 

Esprit 

["Pride:  Show  It  Everywhere"] 

38.0% 

2282 

2.74 

[4.31] 

10. 

Don't  Drink 

["One  Way  or  Another  You'll  End 

Up  With  a  Designated  Driver"] 

35.5% 

2163 

2.76 

[4.48] 

7. 

Physical  Fitness 
["Warning!  Exercise  Can  Cause 
Visible  Side  Effects'! 

34.5% 

2125 

2.43 

[3.87] 

3. 

Motor  Cycle  Safety 
["Do  You  Have  to  Get  Hit 

Over  the  Head  to  Realize..."] 

33.0% 

2101 

2.60 

[4.27] 

2. 

OP  SEC 

["Little  Scraps  Can  Add  Up  to 
a  Whale  of  a  Lot"] 

31.5% 

2049 

2.32 

[3.75] 

11. 

Eat  from  Real  Food 
["Hey!  I  Eat  From  the  Four 

Basic  Food  Groups  Daily...”] 

29.0% 

1921 

2.21 

[3.70] 

5. 

Smoking  Avoidance 

["They  Used  to  Call  Him  Smokey"] 

28.5% 

1911 

2.19 

[3.67] 
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8. 

AIDS 

["Will  the  Fear  of  AIDS  Make 

You  Eat  Alone?"] 

27.5% 

1879 

2.29 

[3.93] 

9. 

Blood  Cholesterol 

["Stake  Your  Life  on  the  Count"] 

26.0% 

1830 

2.16 

[3.71] 

12. 

Black  History  Month 
["Look  Where  You’ve  Been 

To  See  Where  You're  Going"] 

23.3% 

1733 

2.21 

[3.98] 

6. 

Credit  Card  Debt 

["Did  You  Ever  Wonder  How 

23.0% 

1727 

2.06 

[3.62] 

a  Fly  Could  be  so  Blind?"] 

A  comparison  of  Figs.  II- 1  and  0-2  indicates  that  recall  and  effectiveness  are 
unrelated  or  inversely  related. 

2.  Service  Affiliation  and  Pay  Grade  Differences  in  Evaluations  of  the 
Posters 

The  more  experienced  and  higher  ranking  personnel  are  more  critical  than  the  less 
experienced  and  lower  ranking  personnel  (i.e.,  they  are  more  inclined  to  rate  the  posters  as 
ineffective).  These  findings  should  not  be  troubling  if  the  principal  target  audience  for 
these  posters  is  the  young,  first-term  enlistee! 

About  three  in  four  who  report  seeing  the  posters  say  they  see  them  in  the  work 
area.  E5-E6s  are  somewhat  more  likely  than  others  to  see  the  posters  in  their  barracks  and 
in  the  library,  but  they  are  most  likely  see  them  in  the  work  area  (see  Table  n-2).  Air  Force 
(58  percent)  and  Army  (51  percent)  personnel  are  the  most  likely  to  say  they  have  "never 
seen"  the  posters.  Only  14  percent  of  the  Navy  and  33  percent  of  the  Marine  Corps 
personnel  say  they  have  "never  seen"  the  posters.  While  respondents  as  a  group  say  they 
mostly  see  the  posters  in  the  work  area.  Army  personnel  are  more  likely  than  others  to  see 
the  posters  in  the  barracks.  Navy  personnel  in  the  dining  area,  and  Air  Fence  personnel  in 
the  library  (see  Table  n-3). 

We  then  looked  for  differences  in  effectiveness  ratings  as  a  function  of  service 
affiliation  and  pay  grade.  Non-prior  service  personnel  (El-E4s)  were  more  likely  than 
others  to  rate  Posters  1, 3, 6, 8,  and  10  as  more  effective  while  E5-E6s  rated  Posters  3, 5, 
and  10  as  more  effective.  Commissioned  officers,  more  than  others,  gave  the  posters 
relatively  low  ratings.  Company  grade  officers  were  more  likely  than  others  to  give  Iowa- 
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Figure  11-2.  Bit 


Table  11-2.  Pay  Grade  Differences  In  Where  Billboard  Posters  Are  Seen 


Location 

E1-E4 

(%) 

E5-E6 

<%) 

E7-E9 

(%) 

W1-W4 

(%) 

01-03 

(%) 

04+ 

(%) 

Totals 

Work  Area 

39.6% 

42.2 

43.4 

46.1 

46.2 

38.7 

43.0% 

(1657) 

Barracks 

1.8 

3.0 

1.4 

2.8 

0.5 

0.1 

1.4% 

(55) 

Dining  Area 

3.3 

2.0 

1.1 

• 

0.9 

1.0 

1.4% 

(54) 

Library 

4.1 

4.7 

2.5 

2.0 

2.5 

3.1 

3.1% 

(118) 

Service  Club 

1.3 

1.7 

2.2 

2.0 

2.0 

1.4 

1.8% 

(68) 

Elsewhere 

10.0 

10.6 

8.0 

7.8 

8.7 

6.0 

8.4% 

(325) 

Never  Seen 

39.9 

35.8 

41.4 

37.3 

39.2 

49.7 

40.9% 

(1578) 

Totals 

100% 

(389) 

100% 

(592) 

100% 

(1257) 

100% 

(179) 

100% 

(852) 

100% 

(586) 

100% 

(3855) 
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Table  11*3.  Service  Affiliation  Differences  In  Where  Billboard  Posters  Are  Seen 


Location 

Army 

(%) 

Navy 

(%) 

Air  Force 
(%) 

Marines 

(%) 

Total 

Work  Area 

32.5 

69.8 

26.5 

49.8 

43.0% 

(1667) 

Barracks 

3.2 

1.3 

0.5 

0.5 

1.4% 

(55) 

Dining  Area 

1.1 

3.0 

0.3 

1.5 

1.4% 

(54) 

Library 

2.5 

2.4 

3.8 

3.6 

3.1% 

(119) 

Service  Club 

1.7 

1.8 

1.7 

2.0 

1.8% 

(69) 

Elsewhere 

8.3 

7.4 

8.7 

9.4 

8.4% 

(325) 

Never  Seen 

50.7 

14.3 

58.4 

3.3 

40.9% 

(1587) 

Totals 

100% 

100% 

100% 

100% 

100% 

(1034) 

(1007) 

(1228) 

(607) 

(3876) 

ratings  to  Posters  2,  6,  and  9.  Field  grade  officers,  more  than  others,  were  more  likely  to 
give  lower  ratings  to  Posters  1,  2,  3,  5,  6,  8  and  10.  These  findings  are  illustrated  in 
Tables  II-4  and  II-5.  The  t  test  used  in  Table  H-4  and  other  tables  compares  the  means  of 
two  samples  by  calculating  Student's  t  statistic  and  comparing  it  to  a  distribution  of  t 
scores.  The  t  tests  the  significance  of  differences  between  means  and  presents  its  results  in 
terms  of  the  probability  (p)  of  such  a  difference  occurring  by  chance.  Statistical  convention 
states  that  a  t  value  with  p  less  than  (<)  0.05  is  considered  significant.  In  other  words, 
such  a  difference  could  happen  by  chance  less  than  5  times  in  100. 

Respondents  were  asked  whether  they  recalled  seeing  each  of  the  12  posters  at 
Question  8  and  again  at  Question  10.  Only  30  percent  of  respondents  who  indicated  in 
Question  8  that  they  recalled  seeing  die  poster  also  responded  positively  in  Question  10  (see 
Table  33-6).  These  particular  respondents  consistently  rate  the  posters  as  more  effective. 


n-io 


Table  11-4.  t  Values  for  Pay  Grade  Differences  In  Billboard  Poster 

Effectiveness  Ratings 

(Mean  Ratings:  1  =  Never;  5  =  Very  Effective;  Q10  Unadjusted)** 


Poster 

E1-E4 

E5-E6 

E7-E9 

W1-W4 

01-03 

04+ 

Totals 

Rank 

1 

2.92* 

2.84 

2.79 

2.78 

-2.63 

-2.52* 

2.74 

3 

2 

2.40 

2.41 

2.36 

2.32 

-2.21* 

-2.20* 

2.32 

6 

3 

2.78* 

2.79* 

-2.58 

-2.41 

-2.54 

-2.42* 

2.60 

4 

4 

3.00 

3.05 

3.03 

-2.89 

-2.89 

-2.92 

2.98 

1 

5 

2.26 

2.33* 

2.21 

-2.16 

-2.11 

-208* 

2.19 

10 

6 

2.24* 

2.16 

2.06 

-2.04 

-1-98* 

-1  -94* 

2.06 

12 

7 

-2.36 

-2.40 

2.43 

-2.40 

2.43 

2.51 

2.43 

5 

8 

2 -55* 

2.36 

-2.26 

-2.24 

-2.25 

-2.15* 

2.29 

7 

9 

2.27 

2.23 

2.18 

-2.08 

-2.05* 

-2.13 

2.16 

11 

10 

2.99* 

2.96* 

-2.74 

-2.58 

-2.70 

-2.54* 

2.76 

2 

11 

2.31 

2.30 

-2.19 

-2.11 

2.21 

-2.12 

2.21 

8.5 

12 

2.32 

2.32 

2.22 

-2.06 

-2.14 

-2.12 

2.21 

8.5 

**  Table  values  are  the  t-values  for  differences  between  average  ratings  based  on  responses  to  question 
10.  unadjusted  for  whether  respondents  indicated  recall  for  question  8.  Those  t-values  on  the  row  which 
are  underlined  (*)  indicate  means  significantly  different  from  the  overall  mean  in  the  total  column  for  that 
row  (t-test  of  difference  between  sample  and  population  mean,  p  <  -  0.05).  Example:  E1-E4s  rated 
poster  1  significantly  higher  than  did  other  military  personnel,  and  the  field  grade  officers  rated  poster  1 
significantly  lower  than  did  other  personnel. 


Some  respondents  did  not  recall  a  poster  on  Q8,  but  after  reviewing  the  broadsheet 
containing  the  posters  that  was  sent  with  the  survey,  they  responded  positively  (Q10). 
These  respondents  were  much  less  likely  to  rate  the  poster  as  effective  in  communicating  its 
message.  Among  respondents  with  highly  stable  levels  of  recall  (those  answering 
positively  to  Q8  and  Q10),  the  most  effective  posters  were;  10, 4, 3, 1  and  12,  respectively 
(see  Table  13-6). 


Table  11-5.  Pay  Grade  Differences  in  Billboard  Poster  Effectiveness  Ratings 
(Mean  Ratings:  1  =  Never;  5  *  Very  Effective;  Q10  Adjusted)* 

Sorted  From  Highest  to  Lowest  Overall  Rating 


Poster 

Totals 

E1-E6 

E7-E9 

Warrant 

Officers 

Commissioned 

Officers 

10 

4.64 

(239) 

4.71 

4.59 

4.69 

4.65 

4 

4.53 

(364) 

4.59 

4.54 

4.35 

4.49 

3 

4.44 

(205) 

4.40 

4.44 

4.13 

4.53 

♦ 

1 

4.41 

(279) 

4.38 

4.43 

4.44 

4.39 

12 

4.32 

(86) 

4.30 

4.46 

4.25 

4.00 

• 

8 

4.18 

(143) 

4.29 

4.12 

4.36 

4.12 

7 

4.10 

(237) 

4.14 

4.13 

4.07 

4.03 

* 

11 

4.08 

(160) 

4.42 

3.98 

4.27 

3.93 

9 

4.04 

(121) 

4.19 

4.14 

4.00 

3.73 

• 

2 

4.01 

(204) 

4.10 

4.44 

4.13 

4.53 

5 

3.92 

(169) 

4.08 

4.00 

3.83 

3.72 

• 

6 

3.92 

(97) 

3.81 

3.98 

3.40 

4.00 

*  Facsimiles  of  all  posters  were  included  with  the  questionnaire.  This  permitted  respondents  to  rate  the 
effectiveness  in  Q10  without  recalling  the  poster  in  08.  Table  values  are  the  average  ratings  from 
respondents  indicating  recall  to  question  10  who  also  said  in  question  8  they  recalled  seeing  the 
respective  poster.  Regardless  of  pay  grade,  respondents  who  reported  recall  for  both  questions  8  and 
10  in  the  survey  gave  significantly  higher  effectiveness  ratings  than  respondents  who  indicated  recall  for 
question  10  but  no  recall  for  question  8. 
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Table  11-6.  Differences  in  Billboard  Poster  Recall  Among  Respondents 
Indicating  "Recall"  for  Both  Question  Probes  (Q8  and  Q10) 
by  Pay  Grade  and  Service  Affiliation 

Pay  Grades  Warrant  Commissioned  Service 

Poster  E1-E6  E7-E9  Officers  Officers  Average  Total 


Number 

Service 

% 

n 

% 

n 

% 

n 

% 

n 

Recall 

Cases 

1 

Army 

23.1 

9 

23.6 

30 

19.5 

8 

20.5 

17 

22.2 

64 

Navy 

38.8 

26 

45.9 

50 

42.9 

6 

44.6 

37 

43.8 

119 

Air  Force 

26.6 

21 

19.1 

26 

0 

0 

17 

17 

21.0 

64 

Marines 

27.6 

8 

22.4 

13 

42.9 

3 

17.1 

6 

24.8 

30 

2 

Army 

10.3 

4 

13.3 

17 

14.6 

6 

9.8 

8 

12.4 

35 

Navy 

41.6 

28 

42.2 

46 

46.7 

7 

49.4 

41 

44.8 

122 

Air  Force 

6.3 

5 

3.8 

5 

0 

0 

5 

5 

5.0 

15 

Marines 

37.9 

111 

18.6 

11 

28.6 

2 

22.9 

8 

35.2 

132 

3 

Army 

22.5 

9 

10.9 

14 

4.9 

2 

7.4 

6 

13.2 

31 

Navy 

44.8 

30 

34.9 

37 

42.9 

14 

36.1 

30 

38.9 

111 

Air  Force 

16.5 

13 

14 

19 

0 

0 

13 

13 

14.4 

45 

Marines 

44.5 

13 

13.8 

8 

0 

0 

1 1.4 

4 

29.4 

25 

4 

Army 

28.9 

11 

29.7 

38 

22.5 

9 

30.9 

25 

29.2 

83 

Navy 

41.8 

28 

53.3 

57 

78.6 

11 

45.8 

38 

50.8 

134 

Air  Force 

29.1 

23 

31.9 

43 

0 

0 

27 

27 

29.8 

93 

Marines 

63.3 

19 

35 

21 

42.9 

26 

25.7 

9 

43.8 

75 

5 

Army 

7.7 

3 

9.4 

12 

11.9 

5 

13.3 

11 

11.0 

31 

Navy 

31.3 

21 

29 

31 

46.2 

6 

33.7 

28 

32.3 

86 

Air  Force 

9.1 

7 

8.9 

12 

0 

0 

8.1 

8 

8.7 

27 

Marines 

20.7 

6 

16.9 

10 

14.3 

1 

20 

7 

18.6 

24 

6 

Army 

5.1 

2 

7 

9 

0 

0 

4.9 

4 

6.2 

15 

Navy 

14.9 

10 

18.5 

20 

35.7 

5 

13.3 

11 

18.3 

46 

Air  Force 

3.8 

3 

9.6 

13 

0 

0 

4 

4 

7.6 

20 

Marines 

20.7 

6 

11.9 

7 

0 

0 

8.6 

3 

14.6 

16 

(continued) 
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Table  11*6  (continued) 


Pay  Grades  Warrant  Commissioned  Service 

Poster  E1-E6  E7-E9  Officers  Officers  Average  Total 


Number 

Service 

% 

n 

% 

n 

% 

n 

% 

n 

Recall 

Cases 

7 

Army 

23.1 

9 

13.3 

17 

19.5 

8 

22.9 

19 

19.3 

53 

Navy 

39.4 

26 

46.3 

50 

42.9 

6 

45.1 

37 

44.2 

119 

Air  Force 

10.4 

8 

11.9 

16 

0 

0 

8 

8 

10.6 

32 

Marines 

25 

7 

18.6 

11 

14.3 

1 

37.1 

13 

27.4 

32 

8 

Army 

10.5 

4 

10.9 

14 

14.6 

6 

9.8 

8 

11.3 

32 

Navy 

31.3 

21 

25.7 

27 

28.6 

4 

28 

23 

28.1 

75 

Air  Force 

7.7 

6 

6 

8 

0 

0 

6 

6 

6.5 

20 

Marines 

24.1 

7 

3.4 

2 

14.3 

1 

17.1 

16 

17.8 

26 

9 

Army 

5.3 

2 

6.3 

8 

7.3 

3 

3.6 

3 

5.9 

16 

Navy 

16.7 

11 

27.8 

30 

21.4 

3 

24.1 

20 

24.4 

64 

Air  Force 

9 

7 

11.3 

15 

0 

0 

2 

2 

9.9 

24 

Marines 

7 

7 

6.8 

4 

0 

0 

14.3 

5 

9.2 

16 

10 

Army 

20 

8 

13.4 

17 

19 

8 

11 

9 

15.2 

42 

Navy 

40.3 

27 

43 

46 

28.6 

4 

44.6 

37 

42.4 

114 

Air  Force 

20.5 

16 

19.9 

27 

0 

0 

9 

9 

18.2 

52 

Marines 

33.3 

10 

16.9 

10 

14.3 

28.6 

10 

26.3 

30 

11 

Army 

10.3 

4 

7.9 

10 

10 

4 

4.9 

4 

8.2 

22 

Navy 

32.8 

22 

31.1 

33 

35.7 

5 

45.8 

38 

37.4 

98 

Air  Force 

7.6 

6 

5.3 

7 

0 

0 

5 

5 

6.0 

18 

Marines 

13.8 

4 

11.9 

7 

28.6 

2 

22.9 

8 

18.0 

21 

12 

Army 

10.3 

4 

11.7 

15 

4.8 

2 

4.9 

4 

9.8 

25 

Navy 

14.9 

10 

11.4 

12 

42.9 

6 

4.9 

4 

17.6 

32 

Air  Faroe 

11.5 

9 

2.2 

3 

0 

0 

4 

4 

7.9 

16 

Marines 

13.3 

4 

11.9 

7 

0 

0 

5.7 

2 

11.4 

13 

Pay  Grade  Total 

30.75 

655 

27.16 

945 

33.77 

174 

29.38 

661 

Average  Responses 
Recall 
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3.  Billboard  Comments  Analysis 

A  total  of  741  individuals  responded  to  either  question  1 1  (requesting  suggestions 
for  future  poster  topics),  question  12,  (requesting  suggestions  regarding  distribution, 
presentation  and  opinions),  or  both. 

A  breakdown  of  the  written  responses  to  questions  11  and  12,  categorized  by  pay 
grade  and  service  affiliation,  is  provided  in  Table  II-7.  Senior  NCOs  in  the  Navy  (n  =  65) 
and  Air  Force  (n  =  64)  displayed  the  highest  rates  of  comment  inclusion  within  the  entire 
sample,  while  senior  NCOs  across  all  service  branches  provided  the  highest  rate  of 
comment  inclusion  over  all  pay  grades  (30  percent).  Among  service  branches,  the  Air 
Force  (n  =  212, 29  percent).  Navy  (n  =  198,  27  percent)  and  Army  (n  =  196,  27  percent) 
were  approximately  equal  in  the  number  of  comments  received. 

The  individual  responses  to  questions  11  and  12  are  presented  in  Appendix  II-C 
where  the  specific  comments  for  both  survey  items  were  recorded  and  organized  into  broad 
categories  describing  the  general  nature  of  responses.  Responses  to  question  1 1,  which 
addressed  future  poster  topics,  were  categorized  into  broad  subject  areas  such  as  safety 
issues,  family/consumer  concerns,  and  military/security  issues.  Specific  comments 
pertaining  to  a  particular  category  were  then  recorded  within  that  category  and  frequencies 
of  comments  were  tabulated  and  recorded.  Table  II-8  shows  the  overall  frequency  of 
comments  for  each  category  in  response  to  question  1 1.  Examination  of  the  frequencies  of 
responses  indicated  that  the  category  addressing  drug/alcohol  issues  received  the  most 
suggestions  (n  *  224),  followed  by  health  related  topics  (n  =  163),  and  personal 
growth/career  advancement  issues  (n  =  136). 

The  comments  pertaining  to  question  12  were  also  organized  into  general  categories 
of  written  responses,  and  the  specific  comments  and  their  frequencies  were  recorded  within 
each.  Table  H-8  provides  die  overall  frequency  of  comments  for  each  category  of  question 
12.  The  types  of  responses  provided  most  often  for  this  survey  item  included  comments 
regarding  distribution/display  of  the  posters  (n  =  396),  the  appearance  of  the  posters 
(n  =  231),  and  opinions  regarding  other  aspects  of  the  posters  (n  =  136).  Several 
respondents  indicated  that  they  had  never  seen  any  of  the  posters  (n  =  105)  or  had  rarely 
seen  them  (n  =  30). 

Of  those  who  offered  comments  regarding  the  distribution/display  of  the  posters, 
many  suggested  that  AFPPS  widen  poster  distribution  in  general  (n  =  54)  or  find  a  new 
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Table  11*7.  Billboard  Frequency  of  Comments  Received 
by  Pay  Grade  and  Service  Affiliation 


Pay  Grade 

Army 

Navy 

Air  Force 

Marines 

DoD 

Other 

Total 

E1-E4 

22 

24 

36 

32 

1 

115 

15.6 

E5-E6 

26 

41 

44 

19 

130 

17.6 

E7-E9 

49 

65 

64 

43 

221 

29.9 

W1-W4 

13 

6 

3 

1 

23 

3.1 

01-03 

50 

31 

34 

22 

137 

18.5 

04+ 

35 

27 

28 

7 

2 

3 

102 

13.8 

GS3-GS6 

2 

2 

0.3 

GS7-GS9 

1 

1 

0.1 

GS11  + 

1 

2 

3 

0.4 

Other 

2 

3 

5 

0.7 

TOTAL 

196 

26.5 

198 

26.8 

212 

28.7 

126 

17.1 

2 

0.3 

5 

0.7 

739 

100.0 

Two  of  the  741  respondents  failed  to  provide  information  on  both  questions  so  they  were  deleted  from  the 
analysis. 


Table  11-8.  Billboard  Comments,  Frequency  of  Responses 
Within  General  Categories 


Category  Frequency 


Question  11 

Drug/Alcohol 

214 

Health  Issues 

164 

Personal  Growth /Career  Advancement 

136 

Other 

133 

Patriotism^3  ride 

123 

Military/Security  Issues 

120 

Family  Issues 

115 

Safety  Issues 

112 

Ethnic/Racial/Special  Interests/Co ncems 

73 

Financial/Consumer  Issues 

38 

Environmental  Issues 

29 

Question  12 

Distribution/Dispiay 

391 

Appearance 

231 

Opinions 

136 

Subject  Matter 

34 

Never  Seen 

105 

Would  Lite  to  Receive 

34 

Rarely  Seen 

30 

Unnecessary/Category  on  *10 

10 

method  of  distribution  (n  =  36).  Other  frequent  responses  concerning  distribution/display 
included  requests  for  AFPPS  to  provide  a  catalog  of  posters  and  allow  units  to  order 
particular  posters  (n  =  20),  requests  to  send  posters  to  all  units  (n  =  22),  and  suggestions  to 
display  posters  in  public  areas  (n  =  24).  Common  responses  regarding  the  appearance  of 
the  posters  suggested  emphasizing  pictures  over  words  (n  =  51),  increasing  the  graphic 
impact  of  the  posters  (n  =  29),  and  increasing  the  size  of  the  print  (n  =  24).  Many 
respondents  who  offered  opinions  about  the  overall  quality  of  posters  felt  that  they  were 
very  effective  in  conveying  their  messages  (n  =  43). 

Overall,  those  providing  future  poster  recommendations  addressed  a  wide  variety  of 
topics,  the  most  popular  being  drug  and  alcohol  abuse,  health  topics,  and  issues  related  to 
personal  and  professional  growth.  Most  responses  to  question  12  addressed  the  issue  of 
poster  distribution  or  display,  and  suggested  that  AFPPS  widen  the  distribution  of  posters 
and  display  the  posters  in  high-traffic  public  areas.  The  comments,  in  general,  provide 
AFPPS  with  several  ideas  for  future  poster  topics  and  suggestions  for  increasing  the 
effectiveness  of  the  program. 

D.  CONCLUSIONS  AND  RECOMMENDATIONS 

Half  the  audience  is  seeing  four  or  more  posters  a  year,  a  third  seeing  as  many  as 
11  of  them.  The  junior  NCOs  are  particularly  attentive  and  they  give  the  posters  better 
ratings  than  other  personnel  who  are  higher  in  rank  and  more  experienced.  These  first-term 
enlisted  personnel  are  the  most  receptive  audience  for  the  Billboard  posters.  We  inspected 
the  posters  receiving  the  highest  ratings  by  the  various  pay  grades  so  that  AFIS  can  sharpen 
its  message  strategies.  We  also  examined  the  intercorrelation  of  the  posters  to  see  which 
posters  may  cluster  together  in  terms  of  effectiveness.  This  analysis  could  allow  AFIS  to 
place  mutually  reinforcing  messages  in  close  proximity  to  the  posters.  The  popularity  of 
these  posters  among  Navy  personnel  raises  several  interesting  questions.  Does  the  Navy 
display  them  more  effectively  in  the  work  areas?  Are  they  displayed  effectively  in  the 
living  quarters  and  libraries?  Is  there  any  evidence  that  the  subject  matters  of  the  posters 
are  for  some  reason  more  relevant  to  Navy  personnel? 

We  also  recommend  that  AFIS  consider  refining  the  survey  question  concerning 
effectiveness  to  reflect  its  multiple  dimensions.  It  is  very  possible  that  respondents  are 
using  different  criteria  to  judge  the  effectiveness  of  each  poster.  Some  may  be  responding 
to  the  text  only,  some  to  the  colors,  some  to  the  content  and  image,  and  some  may  be 
reacting  to  factors  beyond  our  ability  to  predict.  It  would  be  of  great  value  to  conduct  a 


study  of  the  modalities  through  which  a  poster  conveys  its  message  and  to  include  these 
modalities  as  evaluation  criteria  in  the  next  survey. 

AFIS  should  examine  the  audience  segments  that  find  these  posters  especially 
effective  and  identify  other  sources  of  information  about  these  issues  on  which  these 
audience  segments  depend.  AFIS  should  consider  an  ongoing  audience  feedback  system 
that  focuses  attention  on  where  service  men  and  women  get  their  information  about  issues 
that  materially  affect  their  quality  of  life  and  effectiveness  as  citizens  and  soldiers. 

Those  individuals  who  responded  in  writing  to  the  request  for  additional  poster 
topics  expressed  interest  in  seeing  AFPPS  address  issues  of  drug  and  alcohol  abuse,  health 
and  fitness,  and  personal  growth  and  career  advancement  subjects.  Additional  comments 
suggest  widening  the  distribution,  increasing  display  of  posters  in  public  areas,  and 
emphasizing  graphics  in  conveying  messages. 
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HI.  THE  PRESS  AND  ART  PACK  SURVEY 


A.  BACKGROUND  AND  PURPOSE 

The  mission  of  the  American  Forces  Information  Service  (AFIS)  and  its 
publications  unit,  the  American  Forces  Press  and  Publication  Service  (AFPPS),  is  to 
communicate  internal  information  about  Department  of  Defense  policies  and  programs  to 
the  military  and  civilian  audience  worldwide  through  print  and  broadcast  media.  The 
weekly  Press  and  Art  Pack  news,  feature  and  an  packages  produced  by  AFPPS  for  use  by 
editors  of  internal  information  media  represent  one  means  by  which  AFPPS  accomplishes 
its  mission. 

AFIS  has  established  25  information  objectives  in  suppon  of  Defense  Department 
policy,  and  the  Press  and  Art  Pack  (P&AP)  services  is  one  means  by  which  that 
information  is  communicated  to  the  military  and  civilian  audience.  The  goal  of  P&AP  is  to 
help  military  editors  influence  their  audiences  to  support  the  following  values: 
American/military  heritage;  citizenship/voting;  civilian  work  force;  conservation,  energy 
and  environment;  current  events  and  the  military;  DOD  missions;  DOD  personnel  policies; 
drug  and  alcohol  abuse  control;  education  and  training;  guard  and  reserves;  health  and 
medical  care;  military  balance/threat;  military  benefits.  In  addition,  P&AP  promotes: 
military  family/quality  of  life;  military  law;  operations  and  readiness;  overseas  service; 
personal  affairs;  research,  development,  and  acquisition;  retention;  safety;  security/law 
enforcement;  standards  of  conduct;  fraud,  waste,  and  mismanagement;  equal  employment 
opportunity. 

The  purpose  of  this  study  was  to  determine  whether  the  editors  who  receive  P&AP 
are  using  die  materials,  whether  the  materials  are  received  in  time  fen*  editors  to  meet  their 
deadlines,  whether  the  regular  features  of  P&AP  are  valued  by  the  editors,  whether  the 
materials  duplicate  copy/art  received  from  other  sources,  and  whether  the  audiences  served 
by  the  editors  are  equally  served  by  the  press  and  art  news  and  features  already  provided  by 
AFPPS.  The  P&AP  questionnaire  is  shown  in  Appendix  m-A,  and  Appendix  III-B  shows 
responses  to  each  question  and  a  descriptive  statistical  summary. 
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B .  SURVEY  PROCEDURES  AND  METHODS 

On  August  31,  1989,  the  Allen  Division  of  CAE-Link  Corporation  mailed  a 
questionnaire,  with  return  postage-paid  envelope,  and  cover  letter  from  the  Commander, 
American  Forces  Press  and  Publication  Service  to  the  entire  population  of  1,500  editors 
who  receive  the  press  and  art  pack  services.  Reminder  postcards  were  mailed  10  days 
later.  We  received  921  responses  for  a  61  percent  response  rate.  We  estimate  the  sampling 
error  at  less  than  1  percent 

C.  DISCUSSION  OF  RESULTS 

The  results  of  the  Press  and  Art  Pack  (P&AP)  survey  are  summarized  below  and 
treated  in  detail  in  the  sections  which  follow. 

I .  Overview 

Editors  are  making  extensive  use  of  the  P&AP  services  as  indicated  by  the  fact  that 
37  percent  use  the  articles  and  31  percent  use  P&AP  artwork  in  nearly  every  issue  of  their 
publications.  Also  encouraging  is  the  finding  that  80  percent  use  at  least  some  of  the 
articles  in  each  press  pack  received  and  77  percent  use  at  least  some  of  the  artwork.  The 
survey  also  showed  that  65  percent  of  the  editors  use  the  halftone  reproductions  and 
80  percent  almost  always  file  P&AP  for  reference  and  possible  later  use.  This  is  so  even 
though  editors  report  that  P&AP  "sometimes"  (93  percent)  or  "almost  always"  (7  percent) 
covers  the  same  editorial  materials  as  other  publications  received  by  the  editors. 

The  P&AP  service  gets  high  marks  for  "timeliness."  About  43  percent  of  the 
editors  indicate  that  the  Press  and  Art  Pack  articles  are  "almost  always"  time  sensitive. 
More  than  half  of  the  editors  (57  percent)  say  these  time  sensitive  pieces  are  "almost 
always"  received  early  enough  for  them  to  include  in  their  publications.  Most  editors  judge 
the  telecommunication  center  messages  about  timely  topics  as  "sometimes  useful" 
(66  percent)  while  one  in  five  editors  say  the  service  is  "almost  always"  useful. 

About  43  percent  of  the  editors  indicate  the  production  tips  are  "almost  always" 
useful,  and  another  50  percent  say  the  tips  are  "sometimes"  useful.  Editors  are  mixed  on 
their  evaluations  of  the  length  of  P&AP  copy  with  61  percent  saying  keep  the  articles  the 
same  length,  31  percent  saying  they  prefer  somewhat  shorter  articles,  and  6  percent  saying 
they  want  much  shorter  articles.  Only  two  percent  want  the  articles  to  be  longer.  The 
results  are  discussed  in  more  detail  below  in  terms  of  specific  analyses. 
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2 .  Service  Affiliations  and  Pay  Grades  of  Editor  Sample 

About  45  percent  of  the  editors  are  uniformed  members  of  the  armed  forces  on 
active  duty;  1 1  percent  are  citizen  soldiers,  and  41  percent  are  civilian  employees.  One  in 
three  are  serving  the  Army  or  the  Navy,  20  percent  the  Air  Force,  5  percent  other  DOD 
agencies,  3  percent  the  Marine  Corps,  and  4  percent  the  Coast  Guard.  Thirty-three  percent 
(33  percent)  of  the  respondents  are  GS-9s  or  above  and  35  percent  are  El-E6s.  Another 
8  percent  are  GS1-GS7  civilians  and  8  percent  arc  company  grade  commissioned  officers. 
A  breakdown  of  the  pay  grade  and  service  affiliation  of  the  military  editors  in  our  sample  is 
provided  in  Table  HI-1  so  that  AFIS  can  better  understand  the  background  of  its  client 
editors.  The  Army  and  DoD  agencies/activities  are  much  more  likely  to  employ  higher 
ranking  civilians  in  their  editor  positions  as  indicated  in  the  table.  More  than  one-half  of  all 
the  editors  in  our  sample  from  these  organizations  are  GS-9s  or  above.  On  the  other  hand, 
the  Air  Force  and  Marine  Corps  staff  their  editor  positions  primarily  with  junior  enlisted 
personnel.  Overall,  while  only  one  in  three  of  the  population  of  editors  are  junior  enlisted 
personnel,  two  in  three  of  the  Air  Force  editors  and  9  in  10  of  the  Marine  Corps  editors  are 
El-E6s. 

3 .  Education  Levels  of  the  Editors 

The  editors  have  higher  formal  education  profiles  than  the  enlisted  force.  In  fact, 
their  profiles  are  more  comparable  to  field  grade  officers.  Nine  of  the  editors  have 
doctorates  or  professional  school  degrees,  14  percent  have  masters  and  39  percent 
bachelors  degrees.  Only  5  percent  indicate  high  school  or  the  GED  certificate  as  their 
highest  level  of  education  (see  Appendix  UI-B).  The  majority  of  our  military  editors  are 
enlisted  personnel  who  arc  substantially  more  educated  than  the  active  forces  comprising 
the  audiences  for  their  publications.  When  we  compared  the  educational  profiles  of  enlisted 
and  officer  personnel  as  reported  in  the  Defense  89  Almanac  with  the  educational  profiles 
of  our  editors  (see  Table  HI- 2)  we  found  that  25  percent  of  our  editors  from  the  enlisted 
ranks  hold  bachelors  degrees  while  only  3  percent  of  the  active  enlisted  force  have  earned 
four-year  college  degrees.  The  educational  profile  of  the  1 14  editors  in  our  sample  who  are 
commissioned  officers  is  a  mirror  image  of  the  active  officer  corps  as  a  whole,  37  percent 
have  advanced  degrees,  57  percent  have  bachelors'  degrees  and  fewer  than  6  percent  have 
no  college  degree. 
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Table  111*1.  Pay  Grade  of  Editors  by  Service  Affiliation 


Pay  Grades 

Army 

(%) 

Navy 

(%) 

Air 

Force 

(%) 

Marine 

Corps 

(%) 

Coast 

Guard 

(%) 

DoD 

(%) 

Other 

(%) 

Total 

E1-E6 

18.4 

33.8 

65.1 

87.1 

35.3 

11.9 

10.8 

35.0% 

(299) 

E7-E9 

6.4 

10.1 

4.8 

0.0 

20.6 

9.5 

16.2 

8.2% 

(70) 

W1-W4 

0.4 

0.7 

0.0 

3.2 

5.9 

0.0 

0.0 

0.7% 

(6) 

01-03 

7.1 

7.6 

7.8 

9.7 

11.8 

0.0 

0.0 

7.5% 

(64) 

04+ 

3.8 

4.0 

5.4 

0.0 

0.0 

2.4 

21.6 

4.6% 

(39) 

GS1-GS7 

9.8 

9.7 

3.6 

0.0 

2.9 

14.3 

5.4 

8.0% 

(68) 

GS9+ 

53.4 

30.9 

12.0 

0.0 

14.7 

59.5 

8.1 

32.9% 

(281) 

Other 

0.8 

3.2 

1.2 

0.0 

8.8 

2.4 

27.1 

3.2% 

(27) 

Totals 

100% 

100% 

100% 

100% 

100% 

100% 

100% 

100% 

(266) 

(278) 

(166) 

(31) 

(34) 

(42) 

(37) 

(854) 
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Table  111*2.  Educational  Backgrounds  of  Press  and  Art  Pack 
1989  Editors'  Sample  Versus  Active  Force 


Active*  Force  Sample 

(%)  (%) 


Enlisted  Personnel 

Some  High  School 

2.07 

0.00 

High  School/GED 

91.04 

7.30 

Some  College 

4.43 

63.70 

BA,  BAS 

2.29 

24.90 

Advanced  Degree 

0.17 

4.10 

Officer  Personnel 

Below  BA 

5.09 

5.26 

BA,  BS 

57.76 

57.02 

Advanced  Degree 

37.14 

37.72 

Civilian  Personnel 

GS1-GS7 

GS9+ 

High  School,  GED 

8.82 

2.82 

Some  College 

51.47 

27.10 

BA.BS 

36.76 

49.30 

Advanced  Degree 

2.95 

20.78 

*  Source:  Defense  Almanac  89.  Data  current  31  December  88. 
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Civilian  editors  are  also  better  educated  than  the  enlisted  force  as  a  whole.  About 
38  percent  of  our  editors  in  the  GS  1-7  and  70  percent  in  the  GS-9  or  above  pay  grades 
hold  at  least  a  bachelor's  degree  and  21  percent  hold  advanced  degrees.  According  to 
March  1988  Census  estimates  only  20.3  percent  of  adult  Americans  25  years  of  age  and 
older  have  completed  four  or  more  years  of  college.  Higher  levels  of  education  are 
associated  with  less  frequent  use  of  both  art  and  editorial  services. 

4 .  Profiles  of  Target  Audience  and  Publication  Frequency 

In  terms  of  audience  profiles,  49  percent  of  our  editors  report  that  their  publications 
are  distributed  on  a  CONUS  base  or  installation,  14  percent  report  distribution  on  an 
overseas  base  or  installation,  3  percent  aboard  ship,  and  35  percent  elsewhere.  The  sizes 
of  the  total  target  audiences  including  families  and  civilian  employees  served  by  our  editors 
are  distributed  as  follows: 

•  37  percent  of  the  editors  serve  audiences  of  less  than  2,000 

•  25  percent  serve  audiences  from  2,000-5,000 

•  22  percent  from  5,001-15,000 

•  10  percent  more  than  25,000 

•  7  percent  from  15,001-25,000. 

The  editors  in  our  sample  function  as  the  primary  information  gatekeepers.  Most 
(80  percent)  of  the  editors  decide  which  articles  from  Press  and  Art  Pack  will  be  used  in  the 
publication.  Occasionally,  the  public  affairs  officer  (14  percent)  makes  the  decision  and 
only  rarely  is  the  decision  made  by  the  base  commander  (1  percent).  Most  of  the  editors 
represented  in  this  survey  publish  monthly  (39  percent)  or  quarterly  (23  percent). 
However,  there  are  also  editors  who  publish  daily  (3  percent),  weekly  (13  percent), 
biweekly  (11  percent),  and  bimonthly  (9  percent).  Eighteen  editors  apparently  are  under 
different  deadlines. 

Publication  frequency  and  size  of  target  audience  have  been  shown  to  influence 
levels  of  P&AP  utilization  and  satisfaction  by  our  editors.  Our  analysis  indicates  that  there 
are  also  service  differences  in  these  areas.  For  example,  our  Army  editors  apparently 
publish  less  frequently  than  editors  from  other  services  and  they  tend  to  serve  a  much  larger 
audience.  Our  Air  Force  editors  publish  more  frequently  than  editors  from  the  other 
services,  and  Navy  editors  are  serving  a  smaller  target  audience.  These  results  are  shown 
in  Table  HI-3. 


Table  111*3.  t-Values  for  Differences  In  Frequency  of  Publication  and 
Target  Audience  Size,  Editors  1989  Survey 


Service 

Frequency  of  Publication 
(06:  1  -  Daily 

7  -  Other) 

Target  Audience  Size 
(Q10:  1  -  <  2000 

5  *  >  25,000) 

t-value 

Cases 

t-value 

Cases 

Army 

4.04 

272 

2.51 

277 

Navy 

-3.82 

274 

-2.06 

282 

Air  Force 

-3.25 

182 

2.41 

182 

Marines 

-3.52 

29 

-2.13 

31 

Coast  Guard 

4.09 

34 

-1.68 

34 

DoD 

4.27 

44 

-2.19 

43 

Other 

4.82 

44 

-2.02 

44 

Overall  Mean 

3.85 

879 

2.27 

883 

5 .  Utility  of  P&AP  Copy,  Art,  and  Features 

The  subjects  of  the  most  frequently  used  artwork  provided  in  P&AP  are  listed 
below  in  order  of  their  positive  usage. 

•  Promotional/Seasonal  Art  (37  percent  almost  always;  14  percent  never  use) 

•  Fitness/Health  (28  percent  almost  always;  25  percent  never  use) 

•  Sports/Recreation  (20  percent  almost  always;  21  percent  never  use) 

•  Duty/Life  (14  percent  almost  always;  30  percent  never  use) 

•  Domestic/Consumer  (13  percent  almost  always;  25  percent  never  use) 

•  Military  Hardware  (9  percent  almost  always;  40  percent  never  use) 

•  Tactical/Field  Scenes  (9  percent  almost  always;  54  percent  never  use). 

The  overseas  editors  (n  =  316)  are  mixed  on  the  use  of  the  copy/artwork  provided 
for  the  Combined  Federal  Campaign  since  34  percent  use  less  than  half  the  material 
provided  before  each  campaign  and  44  percent  use  none  or  almost  none  of  the  material 
pertaining  to  these  campaigns. 
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We  fit  99  percent  confidence  interval  estimates  around  the  rankings  of  the  standing 
features  based  on  the  sample  means  and  standard  errors  of  estimate  of  responses  to  a  four- 
point  scale  ranging  from  1  =  Cancel  to  4  =  More  Often  (see  Fig.  HI-1).  We  estimated  the 
ratings,  listed  in  order  of  highest  to  lowest  rated  feature,  that  would  be  rendered  by  the 


universe  of  1500  editors  to  vary  as  follows: 

•  "Between  the  Lines" 

3.29-3.44 

•  "National  Defense" 

2.94-3.00 

•  "On  This  Date" 

2.73-2.79 

•  "Worth  Repeating  Quotes" 

2.64-2.70 

•  "Do  You  Know" 

2.51-2.57. 

Editors  want  more  copy  and  art  targeted  to  civilian  employees.  The  mandate  is  clear 
since,  in  response  to  Question  17,  34  percent  say  they  need  more  material  compared  to 
22  percent  who  want  less  material  targeted  to  the  civilian  employee  audience.  Equally  as 
clear  is  the  mandate  to  decrease  the  copy  and  art  targeted  to  the  reserve  components  with 
42  percent  of  the  editors  wanting  less  compared  to  24  percent  who  want  more.  Editors  are 
most  satisfied  with  the  copy  and  art  now  targeted  toward  active  duty  personnel  and 
dependents. 

Our  findings  concerning  how  often  the  editors  use  P&AP  art  (Q14)  shows  that 
frequency  of  publication  and  size  of  target  audience  have  only  a  modest  influence  on  ait 
usage.  Editors  publishing  daily  make  the  least  use  of  the  art  services,  but  editors 
publishing  weekly  and  bi-weekly  report  the  greatest  amount  of  usage  (Q14).  Usage  of 
P&AP  art  is  more  likely  by  editors  serving  small  target  audiences;  the  highest  usage  rates 
(Q14)  are  reported  by  editors  serving  audiences  of  less  than  2,000;  from  2,000-5,000,  and 
from  5,001-15,000. 

Our  analysis  of  editors'  use  of  P&AP  copy  (Q15)  shows  that  only  pay  grade  and 
publication  frequency  have  any  influence.  Enlisted  military  and  civilian  editors  report 
greater  usage  than  editors  who  are  commissioned  officers  (the  highest  usage  by  senior 
NCOs  and  the  lowest  by  company  grade  officers).  Weekly,  daily  and  bi-weekly 
publications,  respectively,  make  more  frequent  use  of  the  editorial  package  provided  in 
Press  and  Art  Pack.  The  least  amount  of  usage  is  reported  by  editors  who  publish 
bimonthly  and  quarterly. 


Mean 


Figure  ill-1.  Editors  Ranking  of  Features-- 
1989  Press  and  Art  Pack  Study 


6 .  Press  and  Art  Pack  Comments  Analysis 

A  total  of  159  individuals  responded  to  question  29  requesting  comments  and 
suggestions  regarding  Press  and  Art  Pack.  A  breakdown  of  respondents  to  this  question, 
categorized  by  pay  grade  and  service  affiliation,  is  provided  in  Table  HI-4.  The  Navy 
provided  the  most  comments  (n  =  47, 32  percent),  followed  closely  by  the  Army  (n  =  42, 
29  percent).  Grade  levels  E1-E6  across  all  military  services  (n  =  53, 36  percent),  and  GS9 
and  above  for  civilian  respondents  (n  =  59, 40  percent)  yielded  the  highest  response  rates 
for  written  comments.  Table  m-4  indicates  that  civilians  of  grade  GS9  or  above,  working 
for  the  Army  (n  =  26)  and  Navy  (n  =  20)  had  the  highest  response  rates. 

The  individual  responses  to  question  29  are  presented  in  Appendix  III-C  and  their 
categories  and  frequencies  are  shown  in  Table  UI-5..  The  comments  in  response  to  this 
survey  item  were  organized  into  broad  categories  describing  the  general  nature  of 
responses.  General  comment  categories  for  Press  and  Art  Pack  included  art,  copy, 
distribution,  suggestions  and  opinions.  Within  the  general  category  of  art,  subcategories 
concerning  the  content  of  each  specific  type  of  art,  art  presentation,  and  usage  were 
addressed.  A  similar  breakdown  into  subcategories  was  used  for  comments  relating  to 
copy.  The  specific  comments  from  each  respondent  were  recorded  within  the  appropriate 
general  and  subcategory.  The  types  of  comments  provided  most  often  in  response  to  this 
survey  question  fell  into  the  general  category  of  art  (n  =  120),  followed  by  comments 
concerning  copy  (n  =  80).  Several  individuals  (n  =  49)  provided  opinions  concerning  the 
overall  quality  of  Press  and  Art  Pack. 

Many  of  those  who  provided  comments  concerning  the  content  of  the  art  expressed 
a  need  for  specific  artwork,  such  as  seasonal  art,  emblems,  and  Coast  Guard  material. 
Comments  regarding  the  presentation  of  artwork  requested  more  smaller  pieces  be 
provided.  Respondents  who  commented  on  the  general  category  of  copy  provided  by 
Press  and  Art  Pack  addressed  the  issues  of  style  most  often  by  requesting  that  articles  be 
shortened  and  made  more  generic.  Ideas  for  article  topics  were  also  provided  by  several 
respondents  in  areas  such  as  health  and  fitness.  Guard  and  Reserves,  and  family  issues. 

Those  who  addressed  the  issues  of  the  distribution  of  Press  and  Art  Pack  suggested 
that  the  information  be  made  available  to  editors  on  computer  disk  or  through  electronic 
communication  networks.  Many  editors  also  noted  that  they  often  receive  seasonal  and 
time  sensitive  material  too  late  for  inclusion  in  their  publications,  and  suggest  that  AFPPS 
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Table  111*4.  Press  and  Art  Pack  Frequency  of  Comments  Received 
by  Pay  Grade  and  Service  Affiliation 


Pay  Grade 

Army 

Navy 

Air  Force 

Marines 

Coast  Guard 

DoD 

Other 

Total 

E1-E6 

8 

15 

18 

9 

3 

53 

36.3 

E7-E9 

2 

2 

1 

• 

4 

9 

6.2 

01-03 

2 

2 

1 

5 

3.4 

04+ 

2 

2 

1 

5 

3.4 

GS1-GS7 

3 

4 

7 

4.8 

GS9+ 

26 

20 

3 

2 

8 

59 

40.4 

Other 

1 

2 

2 

3 

8 

5.5 

TOTAL 

42 

47 

25 

9 

11 

8 

4 

146 

28.8 

32.2 

17.1 

6.2 

7.5 

5.5 

2.7 

100.0 

Table  lll*5.  Press  and  Art  Pack  Comments,  Frequency  of  Responses 

Within  General  Categories 

Category  Frequency 


Art 

115 

Copy 

73 

Distribution 

30 

Hints 

17 

Opinions 

48 

m-n 


distribute  this  type  of  material  earlier.  Further  suggestions  involved  requests  for  more 
instructional  information,  such  as  "Production  Tips"  and  the  creation  of  a  mechanism  for 
editors  to  share  their  production  ideas  with  AFPPS  and  other  editors.  Other  opinions 
regarding  Press  and  Art  Pack  note  that  the  quality  of  the  art  is  often  poor,  little  information 
is  applicable  to  DoD  civilians,  and  the  information  and  art  is  sometimes  dated.  Others, 
however,  consider  Press  and  Art  Pack  a  valuable  resource  providing  e  variety  of 
information  they  use  often. 

Overall,  the  editors  noted  that  they  frequently  use  the  material  provided  by  Press 
and  Art  Pack,  and  that  their  suggestions  refer  to  changes  that  would  further  increase  their 
usage.  The  comments  in  general  reflect  the  editors'  needs  for  increased  art  in  a  variety  of 
topics  and  styles,  shorter  articles,  and  increased  instruction  as  in  the  form  of  "Production 
Tips." 

D.  CONCLUSIONS  AND  RECOMMENDATIONS 

We  recommend  that  AFIS  carefully  consider  the  impact  of  frequency  of  publication 
and  target  audience  size  on  utilization  of  Press  and  Art  Pack  services.  These  factors 
influence  levels  of  P&AP  utilization  and  editor  satisfaction  and  our  analysis  indicates  there 
are  also  service  differences  in  these  areas.  For  example.  Army  editors  apparently  publish 
less  frequently  than  editors  from  other  services  and  they  tend  to  serve  a  much  larger 
audience.  Air  Force  editors  publish  more  frequently  than  editors  from  the  other  services, 
and  Navy  editors  are  serving  a  significantly  smaller  target  audience.  AFIS  should  tailor  art 
and  copy  materials  to  the  needs  of  the  individual  services,  based  on  their  audience  size, 
frequency  of  publication,  and  the  various  audiences  served  by  the  local  military  media. 

Examination  of  the  comments  of  several  editors  indicates  that  they  express  a  need 
for  specific  types  of  art,  such  as  insignia,  shorter  articles,  and  earlier  distribution  of 
seasonal  information.  Overall,  the  editors  noted  that  they  frequently  use  the  material 
provided  by  Press  and  Art  Pack,  and  their  suggestions  refer  to  changes  that  would  further 
increase  their  usage.  The  comments,  in  general,  reflect  the  editors  needs  for  increased  art 
in  a  variety  of  topics  and  styles,  shorter  articles,  and  increased  instruction  as  in  the  form  of 
"Production  Tips." 


IV.  SUMMARY  OF  FINDINGS 


The  major  findings  of  the  IDA  study  explicitly  related  to  the  original  research 
questions  were  drawn  from  detailed  analyses  of  the  results  of  each  survey.  There  are  many 
other  findings  too  numerous  to  relate  in  a  summary  report.  All  data  collected  reside  in  a 
data  base  and  are  available  for  further  analyses  at  any  time.  The  major  findings  are 
presented  relative  to  each  of  the  surveys  conducted  in  the  sections  below.  Immediately 
following  this  presentation  we  provide  our  overall  recommendations  regarding  the 
emphasis  and  timing  of  future  surveys. 

A.  DEFENSE  MAGAZINE 

Our  analyses  conclude  that  more  members  of  the  audience  today  compared  to  1986 
are  seeing  Defense  and  more  are  seeing  it  on  a  regular  basis.  Furthermore,  senior  military 
and  civilian  members  of  the  audience  (e.g.,  field  grade  officers  and  GS  13-15)  are 
significantly  more  likely  to  see  Defense  on  a  consistent  basis,  and  senior  civilian  employees 
are  more  likely  than  any  other  member  of  the  audience  to  give  Defense  high  usefulness 
ratings.  When  viewed  by  service.  Army  and  Marine  Corps  personnel  are  more  likely  to  see 
Defense  on  a  consistent  basis,  and  members  of  the  Air  Force  and  those  working  for  DoD 
agencies/activities  are  less  likely  to  see  it  consistently.  Army  personnel  provide 
significantly  higher  evaluations  of  effectiveness,  and  Navy  personnel  provide  significantly 
lower  evaluations  than  do  personnel  affiliated  with  the  other  services. 

Defense  is  easy  to  read  by  enlisted,  officer,  and  civilian  members  of  the  audience. 
However,  even  though  readers  find  the  magazine  easy  to  read,  they  do  not  find  it  quite  as 
useful  today  as  they  reported  in  1986.  In  addition,  our  analysis  shows  that  audience 
members  who  see  the  magazine  on  a  consistent  basis,  who  believe  it  focuses  on  policy 
issues,  and  who  are  general  officers/GS  13-15  employees  give  the  magazine  more 
favorable  evaluations  than  other  elements  of  the  audience.  Therefore,  we  recommend  that 
the  editors  of  Defense  sharply  define  the  target  audience  and  make  a  consistent  effort  to 
ensure  that  the  magazine  is  reaching  the  intended  audience  through  the  mail/routing  system 
since  63  percent  get  their  copy  this  way.  The  effectiveness  of  the  distribution  systems  used 
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by  the  respective  services  has  not  been  addressed  in  this  report  and  should  be  the  subject  of 
further  studies. 

It  was  also  discovered  that  each  service  defines  its  target  audience  differently  and 
therefore  it  does  not  distribute  Defense  on  the  basis  of  comparable  ratios  of  copies  to 
members  across  the  population.  Therefore,  the  IDA  study  team  recommends  that  AFIS 
balance  the  ratio  of  members  to  copies,  either  by  increasing  the  print  run  and  allocating 
more  copies  to  the  Marine  Corps,  Navy,  and  Air  Force,  or  by  cutting  the  Army  and  DoD 
Agencies  allocation  and  distributing  the  copies  saved  to  the  other  Services. 

B.  BILLBOARD 

The  conclusions  from  the  Billboard  survey  are  very  positive  based  on  the 
extraordinary  number  of  active  duty  personnel  who  report  seeing  the  posters.  Half  the 
audience  is  seeing  four  or  more  posters  a  year,  with  a  third  seeing  as  many  as  1 1  of  them. 
The  junior  NCOs  are  particularly  attentive  and  they  give  the  posters  better  effectiveness 
ratings  than  higher  ranked/more  experienced  personnel.  We  recommend  that  these  junior 
enlisted  personnel  should  be  the  target  audience  for  the  Billboard  posters.  We  have  also 
identified  the  posters  receiving  the  highest  ratings  by  the  various  pay  grades  and 
investigated  the  interrelationship  of  the  posters  to  see  which  cluster  together  in  terms  of 
effectiveness.  This  will  allow  AFIS  to  sharpen  its  strategies  by  understanding  which  levels 
to  target  with  which  messages  and  which  messages  reinforce  each  other. 

We  also  concluded  that  the  posters  receive  the  highest  popularity  ratings  among 
Navy  personnel.  This  raises  several  interesting  questions.  Does  the  Navy  display  them 
more  effectively  in  the  work  areas?  Are  they  displayed  effectively  in  the  living  quarters  and 
libraries?  Is  there  any  evidence  that  the  subject  matters  of  the  posters  are  for  some  reason 
more  relevant  to  Navy  personnel?  We  recommend  follow  up  interviews  with  a  selected 
sample  of  Navy  respondents  to  determine  what  the  Navy  is  doing  so  that  these  lessons 
learned  can  be  promulgated  to  the  other  services. 

Finally,  we  have  concluded  that  AFIS  should  use  auxiliary  media  channels 
(including  post  newspapers,  cable  channels  and  unit  bulletin  boards)  to  frequently 
disseminate  messages  that  reinforce  the  themes  of  the  Billboard  messages.  AFIS  should 
examine  the  market  segments  that  find  these  posters  especially  effective  and  determine  other 
sources  of  information  about  these  issues  on  which  these  audience  segments  depend. 


C.  PRESS  AND  ART  PACK 


Based  on  our  findings  and  conclusions,  we  recommend  that  AFIS  carefully 
examine  the  impact  of  publication  frequency  and  target  audience  size  on  editors'  utilization 
of  Press  and  Art  Pack  services.  These  factors  have  been  shown  to  influence  levels  of 
P&AP  utilization  and  editor  satisfaction  and  our  analysis  indicates  there  are  service 
differences  in  these  areas.  For  example,  our  Army  editors  apparently  publish  less 
frequently  than  editors  from  other  services,  and  they  tend  to  serve  a  much  larger  audience. 
Our  Air  Force  editors  publish  more  frequently  than  editors  from  the  other  services,  and 
Navy  editors  are  serving  a  significantly  smaller  target  audience.  So  AFIS  might  experiment 
with  trying  to  tailor  art  and  copy  materials  to  the  needs  of  the  individual  services,  based  on 
their  audience  size,  frequency  of  publication,  and  the  various  "publics"  served  by  the  local 
military  media. 

D.  OVERALL  RECOMMENDATIONS 

The  IDA  study  team  recommends  that  AFIS  establish  a  systematic  mechanism  by 
which  to  communicate  the  results  of  these  and  other  relevant  surveys  to  their  editors  in  the 
various  services.  This  system  should  be  designed  to  help  AFIS  editors  and  distribution 
executives  to  understand  which  of  their  market  segments  are  most  likely  to  realize 
enhancement  in  quality  of  life  and  performance  by  reading  Defense.  AFIS  also  should 
consider  establishing  an  ongoing  audience  feedback  effort  to  feed  this  system  with  the 
information  it  needs.  This  feedback  system  could  have  two  components;  informal  "tear 
out"  questionnaires  inserted  in  the  periodicals  and  formal  surveys  conducted  every  three 
years.  Both  of  these  media  would  be  used  to  measure  the  effectiveness  of  changes  made  in 
the  periodicals  in  response  to  audience  input  We  further  recommend  that  the  basic  content 
of  the  survey  questionnaire  must  be  constant  from  year  to  year  to  allow  comparisons; 
however,  specialized  sections  may  be  added  as  new  issues  present  themselves  for 
resolution.  In  addition,  we  recommend  the  design  and  development  of  an  audience 
response  data  base  housed  within  AFIS,  but  accessible  to  all  interested  DoD  editors  via  a 
distributed  network. 
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APPENDIX  I-A 


DEFENSE  MAGAZINE  QUESTIONNAIRE 


I-A-l 


DEFENSE  MAGAZINE  READERSHIP  SURVEY 


RCS  #DD  -  PA(OT)  1 823 


I 


I 


1.  My  organization  is:(mark  one 

C  Army  2  Ccas;  Guard 

C  Navy  2  DoC  -:anc// Activity 

O  Air  Force  2  Other  Soecify 

O  Marines  I - 


2.  My  organization  is:  (mark  one> 

2  Active 

2  Reserve  or  National  Guard 
2  Other,  Spec  :y 


3.  My  current  status  is:  (mark  ail  that  apply) 

2  Active  Duty  2  Civiiia-  Emcloyee 

2  Reservist  2  Other  Specify 

2  National  Guard  - 1 - 


4.  My  pay  graae  is:  'mark  all  tha;  apply) 


Enlisted 

2  El-ES 
2  E7-E9 


Officer 


QMliil 
:  G31-3312 
:  G3.'G’.“  3-GS/GM1 5 

:  ses 


.  W1-W4 
.  01-33 

'  04-06 
I  07  or  accve 


2  Other  icecifv 


7.  Defense  magazine  is  published  bimonthly 
(every  other  month).  I  see  Defense  magazine: 

2  Bi-monthly 

2  Periodically  (at  least  3  issues  per  year) 

2  Rareiv  (about  i  issue  per  year) 

2  The  September/October  "almanac  issue"  only 

2  Never  -  (IF  SO  SKIP  TO  QUESTION  19) 


8.  I  usually  receive  Defense  magazine:  (mark 
all  that  apply) 

-  Through  the  mail/routing  system 
2  From  a  co-worker 
2  Througn  the  library 
2  From  another  source.  Specify 


9.  The  most  recent  issue  of  Defense 
magazine  I  received  was  dated: 

-  September/October  (Almanac  Issue) 
2  November/December 
'  January/February 
'  .March  April 
Mav June 
July  August 


Dor.  t  remember 


5.  My  highest  level  of  education  is: 

2  High  school  graduate  or  GED 
2  Some  college 
Bachelor's  degree 
2)  Master's  degree 
2  Ph.D./professional  degree 

6.  My  present  zip  code  at  work  is: 

II  your  op  coda  has  only  5  digits,  Macfcan  crdaa  to  indicato  them 
in  tha  Mt  Mock  batow:  i 1 9  digits  contanua  >n  tot  right  Mock. 

©GOO©  ©OOO 

OOOOO  OOOO 

®®®®®  ®®®@ 

i®00®©  00®0 

I®  0  0  0  0  ®®0® 

10®®®®  0000 

!®®®®®  ®0®0 

000®®  000® 

00000  0000 


10.  My  copy  of  Detenat  magazine  is:  (mark  all 
that  apply) 

-  Kept  in  my  files  for  future  reference 
2  Passed  along  to  others 
2  Sent  to  the  library 
2  Thrown  out 
2  Other.Specify 


11.  Compared  to  other  magazines  of  this  sort, 
I  find  Defense  magazine _ to  read. 

2  Very  easy 
2  Easy 
2  Difficult 
2  Very  difficult 


um 


^OOBOBOMOMOBOQOBOOQOOqqI 


PLEASE  COffflNUE  ON  omen 


I-A-3 


12.  |  find  the  list  of  major  topics  cresented  on 
the  cover  of  Defense  magazine  to  be 
_ in  planning  my  reading. 

O  Very  helpful 
O  Helpful 
O  Seldom  heioful 
O  Not  helpful 

13.  The  number  of  charts  and  grsohs  in 
Defense  magazine  should  be: 

O  Increased 
O  Left  the  same 
O  Decreased 

14.  The  number  of  pictures  and  cnotographs 
in  Defense  magazine  should  :e: 

O  Increased 
C  Left  the  same 
C  Decreased 

15.  I  agree/disagree  that  Defense  magazine: 
(mark  one  response  for  each  statement) 

STRONGl-  DISAGREE 
: 3 AGREE  I 
AG-iE  | 

STRONGLY  AGREE  |  | 

▼  T  V  t 


a.  Presents  timely  tcotcs 

COCO 

b.  Helps  increase  my  knowledge  of  DoD 
policies,  programs 

cooo 

c  Gives  imormauon  and  cerscectives  on 
DoD  poucies  not  'cuna  eisewnere 

cooo 

d  Is  particularly  relevant  to  my  duties 

zonn 

16.  I  find  Defense  magazine,  as  a  source  of 
information  in  each  of  the  following  areas 
is:  (mark  the  one  best  response  for  each 

area)  OF  NO  USE 

OF  LITTLE  USE  I 

US-JL  I 

VERYUSEa.  |  |  ^ 

a.  Military  balance/Soviet  threat  roroi 

b.  OoO  manpower  and  personnel  issuea  O  O  O  O 


c.  Operations  and  readiness  OOOO 

d.  Research  and  development  OOOO 

e.  Guard/Reserves  OOOO 

(.  Defense  missions  oooq 

g.  Acquisition/procurement  OOOO 

h.  Olher(s).  Specify  OOOOI 


17.  i  believe  the  amount  of  emphasis  that  Defense 
magazine  places  on  each  of  the  following 
policy  areas  should  be:  (mark  the  one  best 
resoonse  for  each  area) 


LESS 

ABOUT  THE  SAME  I 


a.  Military  balance/Soviet  threat 

roc 

b.  DoD  manpower  and  personnel  issues 

OOO 

c.  Operations  and  readiness 

OOO 

I 

d.  Research  and  development 

OOOl 

e.  Guard/Reserves 

OOOI 

f.  Defense  missions 

OOO! 

g.  Acquisition/ procurement 

odoi 

h  Other(s).  Specify 

OOO! 

18.  I  believe  that  Defense  magazine,  as  a  DoO 
policy  publication  is: 


0  Very  useful 
C  Useful 
O  Of  little  use 
O  Not  useful  at  all 


19.  Please  include  on  a  separate  sheet  of 
paper  your  thoughts  on  how  to  improve 
Defense  magazine  distribution,  subject 
coverage,  method  of  presentation,  or 
whatever  comes  to  mind  that  would  make 
the  magazine  more  available  and/or  useful 
to  you. 


O  Mark  here  if  you  have  submitted 
any  comments  or  suggestions. 


THANK  YOU  FOR  YOUR  SUPPORT  AND  PROFESSIONAL  INSIGHT 
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APPENOIX  l-B:  DESCRIPTIVE  STATISTICS 
DEFENSE  MAGAZINE  1989  AUDIENCE  SURVEY 
(Total  Number  of  Respondents:  4523) 

Question  Response  Cases  Percentage 


Q1: 

"My  organization  is... 

Army 

1299 

28.9 

Navy 

1005 

22.4 

Air  Force 

1160 

25.8 

Marines 

368 

8.2 

DoD  Agency 

597 

13.3 

Other 

04 

1.4 

TOTALS 

4493 

Q2: 

"My  organization  is... 

Active 

3482 

79.7 

Reserve/Guard 

127 

2.9 

Other 

759 

17.4 

TOTALS 

4368 

100.0 

Q3: 

"My  current  status 

Active  Duty 

2535 

57.5 

Reservist 

14 

0.3 

Guardsman 

25 

0.6 

Civilian  Employee 

1803 

40.9 

Other 

35 

0.7 

TOTALS 

4412 

100.0 

Q4: 

"My  pay  grade  is... 

E1-E6 

19 

0.4 

E7-E9 

1266 

28.7 

W1-W4 

268 

6.1 

01-03 

20 

0.5 

04-06 

1012 

23.0 

07+ 

12 

0.3 

GS1-GS12 

967 

22.0 

GS/GM13-15 

686 

15.6 

SES 

1 

0.0 

Other 

154 

3.4 

TOTALS 

4405 

100.0 

Q5: 

"My  highest  level  of 

High  School  Graduate 

education... 

orGED 

413 

9.2 

Some  College 

1575 

35.1 

Bachelor's  Degree 

1155 

25.8 

Master's  Degree 

1088 

24.3 

PhD/Professional 

254 

5.6 

TOTALS 

4485 

100.0 

I-B-3 


Zip  Code  Location 

Europe 

57 

1.3 

of  Respondents 

Far  East 

57 

1.3 

Other 

67 

1.4 

CONUS 

4342 

96.0 

TOTALS 

4523 

100.0 

Q7:  "...1  see  Defense  Magazine... 

Bi-Monthly 

901 

20.1 

Periodically  (at  least 

1201 

26.8 

3  issues  per  year) 
Rarely  (about 

840 

18.8 

1  issue  per  year) 
Almanac  Issue  Only 

10 

0.2 

Never 

1524 

34.1 

TOTALS 

4476 

100.0 

Q8:  "1  usually  receive 

Mail/Routing  System 

1890 

62.6 

Defense  Magazine... 

Co-Worker 

682 

22.6 

Unary 

224 

7.4 

Other  Source 

225 

7.4 

TOTALS 

100.0 

Q9 :  The  most  recent  issue  of 

September/October 

Defense  1  received  was 

Almanac  Issue 

158 

5.4 

dated... 

Nov/Dec 

38 

1.3 

Jan/Feb 

129 

4.4 

Mar/Apr 

234 

7.9 

May/June 

467 

15.8 

Jul/Aug 

755 

25.6* 

Don't  Remember 

1167 

39.6 

TOTALS 

2948 

100.0 

*  The  survey  was  mailed  in  August 

Q1 0:  "My  copy  of  Defense  is ... 

Kept 

115 

4.0 

Passed  Along 

2130 

73.3 

Sent  to  Library 

109 

3.8 

Thrown  Out 

172 

5.9 

Other 

194 

6.7 

Multiple  Responses 

184 

6.3 

TOTALS 

2904 

100.0 

• 

I-B-4 


Q1 1 :  "Compared  to  other  magazines 
of  this  sort  I  find  Defense 


Maaazine  to  read. 

Very  Easy 

350 

12.0 

Easy 

2417 

82.8 

Difficult 

148 

5.1 

Very  Difficult 

4 

0.1 

TOTALS 

2919 

100.0 

Mean:  3.06,  SDV:  0.41 

Q12:  ”1  find  the  list  of  major  topics 

Very  Helpful 

310 

10.7 

presented  on  the  cover  of 

Helpful 

1931 

66.4 

Defense  Magazine  to  be _ 

Seldom  Helpful 

573 

19.7 

in  planning  my  reading. 

Not  Helpful 

96 

3.2 

TOTALS 

2910 

100.0 

Mean:  2.84,  SDV:  0.64 

Q13:  "The  number  of  charts  and 

Increased 

361 

12.7 

graphs  in  Defense  Magazine 

Left  the  Same 

2206 

77.4 

should  be... 

Decreased 

282 

9.9 

TOTALS 

2849 

100.0 

Q14:  "The  number  of  pictures  and 

Increased 

1021 

35.7 

photographs  in  Defense 

Left  the  Same 

1793 

62.7 

Magazine  should  be... 

Decreased 

47 

1.6 

TOTALS 

2861 

100.0 

Q15:  ”1  agree/disagree  that  Defense 

Magazine... 

a.  Presents  Timely  Topics 

Strongly  Agree 

454 

16.0 

Agree 

2283 

80.3 

Disagree 

90 

3.2 

Strongly  Disagree 

17 

0.5 

TOTALS 

2844 

100.0 

Mean:  3.12,  SDV:  0.45 

b.  Helps  increase  my 

Strongly  Agree 

716 

25.0 

knowledge  of  DoD  policies 

Agree 

1922 

67.0 

and  programs 

Disagree 

195 

6.6 

Strongly  Disagree 

36 

1.2 

TOTALS 

2869 

100.0 

Mean:  3.16,  SDV:  0.59 


I-B-5 


Gives  information  and 

Strongly  Agree 

364 

12.8 

perspectives  on  DoD 

Agree 

1785 

62.9 

policies  not  found 

Disagree 

637 

22.4 

* 

elsewhere 

Strongly  Disagree 

52 

1.9 

TOTALS 

2838 

100.0 

Mean:  2.87,  SDV:  0.64 

Is  particularly  relevant  to  my 

Strongly  Agree 

134 

4.7 

• 

duties 

Agree 

1411 

50.0 

Disagree 

1097 

38.9 

Strongly  Disagree 

180 

6.4 

TOTALS 

2822 

100.0 

Mean:  2.53,  SDV:  0.69 

• 

Q1 6:  "I  find  Defense  Magazine,  as  a 


source  of  information  in  each  of  the 

following  areas  is... 

a 

Military  balance/ 

Very  Useful 

500 

17.7 

Soviet  threat 

Useful 

1822 

64.4 

Of  Little  Use 

444 

15.7 

a  No  Use 

63 

2.2 

TOTALS 

2829 

100.0 

Mean:  2.98,  SDV:  0.65 

b. 

DoD  manpower  and 

Very  Useful 

437 

15.4 

personnel  issues 

Useful 

1811 

63.9 

Of  Little  Use 

523 

18.4 

Of  No  Use 

64 

2.3 

TOTALS 

2835 

100.0 

Mean:  2.92,  SDV:  0.65 

c. 

Operations  and 

Very  Useful 

319 

11.3 

readiness 

Useful 

1872 

66.2 

Of  Little  Use 

573 

20.3 

a  No  Use 

64 

2.3 

TOTALS 

2829 

100.0 

Mean:  2 .87,  SDV:  0.62 

d. 

Research  and  development 

Very  Useful 

500 

17.7 

Useful 

1709 

60.5 

Of  Little  Use 

546 

19.3 

Of  No  Use 

72 

2.5 

TOTALS 

2827 

100.0 

Mean:  2.93,  SDV:  0.68 
I-B-6 


e.  Guard/Reserves 


f.  Defense  missions 


g.  Acquisition/procurement 


Very  Useful 

103 

3.7 

Useful 

1063 

38.1 

Of  Little  Use 

1226 

43.9 

Of  No  Use 

399 

14.3 

TOTALS 

2791 

100.0 

Mean:  2.31,  SDV:  0.76 

Very  Useful 

346 

12.3 

Useful 

1868 

66.3 

Of  Little  Use 

533 

18.9 

Of  No  Use 

71 

2.5 

TOTALS 

2818 

100.0 

Mean:  2.88,  SDV:  0.63 

Very  Useful 

363 

12.9 

Useful 

1547 

54.8 

Of  Little  Use 

780 

27.6 

Of  No  Use 

134 

4.7 

TOTALS 

2824 

100.0 

Mean:  2.76,  SDV:  0.73 


Q17:  ”l  believe  the  amount  of 

emphasis  that  Defense  Magazine 
places  on  each  of  the  following 
policy  areas  should  be... 


& 

Miltary  balance/ 

More 

819 

29.3 

Soviet  threat 

About  the  Same 

1818 

65.0 

Less 

158 

5.7 

TOTALS 

2795 

100.0 

b. 

DoD  manpower  and 

More 

1099 

39.3 

personnel  issues 

About  the  Same 

1509 

54.0 

Less 

188 

6.7 

TOTALS 

2796 

100.0 

c. 

Operations  and 

More 

928 

33.3 

readiness 

About  the  Same 

1760 

63.2 

Less 

98 

3.5 

TOTALS 

2786 

100.0 

d. 

Research  and  development 

More 

1001 

36.0 

About  the  Same 

1586 

57.0 

Less 

195 

7.0 

TOTALS 

2782 

100.0 

I-B-7 


e.  Guard/Reserves 

More 

268 

9.7 

About  the  Same 

1620 

58.5 

Less 

881 

31.8 

TOTALS 

2769 

100.0 

1.  Defense  missions 

More 

869 

31.4 

About  the  Same 

1774 

64.1 

Less 

126 

4.5 

TOTALS 

2769 

100.0 

g.  Acquisition/Procurement 

More 

786 

28.3 

About  the  Same 

1627 

58.6 

Less 

365 

13.1 

TOTALS 

2778 

100.0 

Q18:  "1  believe  that  Defense 

Very  Useful 

620 

21.4 

Magazine,  as  a  DoD  policy 

Useful 

1970 

68.0 

publication  is... 

a  Little  Use 

264 

9.1 

Not  Useful  at  All 

42 

1.5 

TOTALS 

2896 

100.0 

Mean:  3.09.  SDV:  0.60 

Q19:  Comments c  howto 

Yes 

278 

6.1 

improve  Dep  ose  Magazine... 
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APPENDIX  \-C— DEFENSE  COMMENTS 

DISTRIBUTION 


poorly  distributed  1 2 

circulate  through  work  areas  7 

*  send  more  civilian,  R&D  4 

alow  some  way  to  order  4 

increase  distribution  4 

distribute  to  squadron;  battalions  3 

send  to  home  address  3 

distribute  like  soldiers  magazine  3 

send  to  company  level  3 

distribute  to  Hbrary  3 

i  usually  see  in  wafting  rooms  3 

send  more  copies  3 

circulate  through  unit  2 

distribute  to  all  PAO  2 

send  to  an  departments  2 

send  to  each  branch  2 

send  more  than  one  copy  per  command  2 

arrives  too  late  in  mai  2 

send  to  al  DoD  employees  1 


send  articles  through  e-mal  1 

send  to  recruiting  stations  1 

send  to  E9  and  higher  ranks  1 

target  group  is  too  smafl  1 

send  to  each  organization  1 

send  to  Natl  Guard  units  1 

have  a  routing  sip  attached  1 

dtetribute  through  al  ranks  _1 

Total  73 


I-C-3 


OPINION 


eliminat  e-waste  of  money 
good  reference  source 
don't  read,  not  applicable  to  duties 
one  sided  view  of  issues 
dry  reading 

easily  accessible  to  enemies 

make  reading  mandatory  for  Sr.  NCO 

too  much  to  read  already 

redundancy  of  info 

too  wordy 

too  DoD  oriented 

unnecessary-other  info  sources  exist 
doawaywth 

too  policy  oriented -bo  ring 
find/use  better  info  sources 
good  for  young  with  miHtary  interest 
must  remain  timely 
remove  me  from  maiing  list 
comprehensive  info  source 
propaganda 
good  magazine 
very  informative 
Total 


I-C-4 


CONTENT 


more  pictures,  graphs,  photos  4 

address  topics  of  pay,  promotion  2 

address  more  legislative  issues  2 

more  procurement  issues  2 

new  products  military  will  use  2 

address  drug  and  alcohol  effects  on  mil  2 

old  v.  new  policy  2 

provide  testimonials  of  pilots  1 

more  sports  and  comics  1 

more  far  east  Mo  1 

more  health  issues  1 

dependent  contributions  1 

maneuvers  and  operations  1 

operations  and  security  1 

column  on  logistics  1 

use  more  art  1 

include  readership  survey  in  each  Issue  1 

address  more  smal  business  issues  1 

do  surveys  of  current  DoD  thinking  1 

contracting  issues  1 

describe  how  programs  are  developed  1 

include  historical  topics  1 

more  enlisted  infantry  issues  1 

narrow  topics  of  articles  1 

address  real  army  issues  _J. 

Total  34 


I-C-5 


STYLE 


written  above  staff  level 

target  less  educated 

give  info  on  future  equip 

provide  technical  drawings,  not  charts 

lower  level  technicians  should  read 

audience  unclear 

content  not  related  to  DoD  supporters 
use  as  a  training  aid 
briefer  writing  style 
too  "chatty" 

make  more  dynamic,  artistic 
too  dry  and  technical 
maintain  a  joint  service  atmosphere 
have  real  authors  sign  by-lines 
present  an  abstract  of  articles 
Total 


6 

2 

2 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 


22 


OTHER 


have  never  seen 

56 

would  Nke  to  receive 

29 

haven’t  seen  in  a  long  time 

28 

no  longer  receive 

Total 

115 

I-C-6 
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ADDRESS  CHANGES 


Old  Address: 

Department  of  the  Navy 
Naval  Sea  Systems  Command 
Pearl  Harbor  Naval  Shipyard 
Box  400  (Code  150) 

Pearl  Harbor,  HI  96860 

New  Address: 

Code  150 

Pearl  Harbor  Naval  Shipyard 
Box  400 

Pearl  Harbor,  HI  96860 


Old  Address: 

Samuel  IV  Hutchins 

Department  of  the  Army 

U.S.  Army  Training  and  Doctrine  Command 

Civilian  Personnel  Office 

POBox  50 

Ft  Leonard  Wood  MO  65473 

New  Address: 

Samuel  IV  Hutchins 
Commandant 

U.S.  Army  Engineer  School 
ATTN:  ATSE-CDT  (Mr.  Hutchins) 

Fort  Leonard  Wood,  MO  65473 


Old  Address: 

Craig  W.  Gsell 
Department  of  Defense 
Defense  Logistics  Agency 
Defense  Pers  Support  Center 
2800  S  20th  Street 
Philadelphia,  PA  19111 

New  Address: 

Craig  W.GseU 
Chief,  Program  Review 
Defense  Personnel  Support  Center 
2800  S.  20th  Street 
ATTN:  DPSC-QR 
Philadelphia,  PA  19101-8419 


ADDRESS  CHANGES  (Continued) 


Old  Address: 

Ira  P.  Isaacson 
Department  of  the  Navy 
Office  of  Naval  Research 
Research  Lab  Employment  Branch 
4555  Overlook  Ave  Southwest 
Washington,  D.C.  20390 

New  Address: 

Ira  P.  Isaacson 
Department  of  the  Navy 
Naval  Research  Lab 
Code  6804 

4555  Overlook  Ave  Southwest 
Washington,  D.C  20375-5000 


ADD  TO  MAILING  LIST 


Albert  A.  Amador 
Code  244.13  0-60 
Mare  Island  Naval  Shipyard 
Vallejo,  CA  94592 


Rodelio  E.  Legaspi 
SFC,  USA 

DOES,  HHC  23rd  QM-BDE  (PP) 
ATTN:  ATSM-EV 


Tim  C.  Tenold 
Department  of  the  Air  Force 
Air  Force  Logistic  Command 
SM-ALC/MABPGB 
McClellan  AFB,  CA  95652 


3096AVDS/QA 

Nellis  AFB,  NV  89191-5000 


Robert  W.  Bryant,  Jr. 
Department  of  the  Navy 
Atlantic  Fleet 
Naval  Simply  Center 
Bldg.  110NASJAX 
JAX.FL  32212 


ADD  TO  MAILING  LIST  (Continued) 


MikeMintzer 
CEHEC-PP 
Corps  of  Engineers 
Washington,  D.C.  20314-1000 


Major  Raymond  C.  Ferrara 
Training  Quota  Manager 
Training  and  Education  Center  (TE-33) 
MCCDC,  Quantico,  VA  22134-5001 


John  R.  Babey 
Office  of  Director, 

Planning  and  Market  Research 
Defense  National  Stockpile  Center 
Defense  Logistics  Agency 
Washington,  DC  20405 


Marine  Corps  Finance  Center 
DAPS-2 

1500  East  95th  Street 
Kansas  City,  MO  64197-0001 
ATTN:  Connie  Hamilton 


Jeff  Frank 
WRALC/MAIPBC 
Robins  AFB,GA  31098 


Louis  F.  Diodato 

Naval  Weapons  Station  Earle 

Hwy  #  34 

Colts  Neck,  N  J.  07722 


Naval  Air  Development  Center 
ATTN:  Robert  P.  Bollard 
Code  5042 

Warminster,  PA  18974 


Dennis  E.  Drum 
Department  of  Defense 
Defense  Mapping  Agency 
Aero  Space  Center/PPIM 
3200  South  Second  Street 
St  Louis,  MO  63118 


RDLL 
Box  19 

FPO,  NY  09510 


ADD  TO  MAILING  LIST  (Continued) 


Design  Div,  Test  Review  Section 
Code  244.3 

Portsmouth  Naval  Shipyaid 
Portsmouth,  N.H.  03804- 50o0 


Department  of  the  Army 
Rock  Island  Arsenal 
SMCRI-AQE-I 
Rock  Island,  IL  61299-5000 
ATTN:  Doyle  W.  Rockey  Jr. 


SIO/SYPT 

Peterson  AFB,  CO  80914-5001 
ATTN:  MajMuolo 


Aeroquip  Corp  Aerospace  Div. 
300  S.  East  Ave., 

Jackson,  MI  49203 
ATTN:  DCASQAR 


Mauris  Watkins 
MABDF 
McClellan  AFB 
Sacramento,  CA  95652 


Maintenance  Management  Branch 

Executive  Directorate  for  Logistics  Operations  (EDLO) 

MCLB,  Albany,  GA  31704 


Harry  H.  Franke 
Contracting  Officer 

Directorate  of  Contracting  and  Manufacturing 
Department  of  the  Air  Fence 

Headquarters  San  Antonio  Air  Logistics  Center  (AFLC) 
Kelly  AFB,  TX  78241-5000 
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ADD  TO  MAILING  LIST  (Continued) 


James  M.  Jasper 
Department  of  Defense 
Defense  Logistics  Agency 
DRMS-LP 
224  Chapel  Hill 
Battle  Creek,  MI  49015 


Production  Base  Modernization  Agency 
AMSMC-FBM-A,  Bldg  171 
Picatinny  Arsenal,  NJ.  07806-5000 
ATTN:  Peter  Mullaney 


Brenda  Jilliska 
DMAAQGAD 
3200  S.  Second  St. 

St  Louis,  MO  63118-3399 


LTC  Robert  R.  Landry 
DCECR-210 
1860  Wiehle  Avenue 
Reston,  VA  22090 


P.F.  Pratt 

Box  30  SAFETY 

FBPO  Norfolk,  V  A  23593 


James  J.  Ready 

U.S.  Army  Corps  of  Engineers 
POBoxJ 
Academy  Drive 
Buzzards  Bay,  MN  02532 
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BILLBOARD  QUESTIONNAIRE 
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BILLBOARD  SURVEY 


nCS  iDO  •  PA(OT)  1823 
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1.  My  organization  is:  (mark  om) 
O  Army 
O  Navy 
O  Air  Force 
O  Marines 
O  Coast  Guard 
O  DoD  Agency/Activity 
O  Other,  Specify 


2.  My  organization  is:  (mark  one) 
O  Active 

O  Reserve  or  National  Guard 
O  Other,  Specify 


3.  My  current  status  is:  (mark  all  that  apply) 

O  Active  Duty 
O  Reservist 
O  National  Guard 
O  Civilian  Employee 
O  Other,  Specify 


4.  I  have  accumulated _ years  of 

active,  reserve,  and/or  civil  service. 

O  Four  or  less 
O  More  than  four 


5.  My  pay  grade  is:  (mark  all  that  apply) 


Enlisted 

O  El  -E4 
OE5-E6 
O  E7-E9 

Officer 

O  W1-W4 
001-03 
Q04  or  above 


CMian 

OGS3-GS6 
OGS7-GS9 
OGS11  ♦ 


O  Other, specify 


6.  My  highest  level  of  education  is: 

O  Some  high  school 
O  High  school  graduate  or  GED 
O  Some  college 
O  Bachelor's  degree 
O  Master's  degree 
O  Ph.DVprofessional  degree 


7.  My  present  zip  code  at  work  is: 

If  your  zip  code  hss  only  5  dig*.  Macfean  dretaa  to  indtcM  twit 
in  tfw  Ml  block  Mow;  if  9  d^rts,  oonanu*  in  #w  light  Modi 
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8.  The  attachments  show  the  12  Defense 
Biiiboard  posters  distributed  over  the  last 
year.  They  are  labeled  Poster  1,  Poster  2,  and 
so  on  through  Poster  12.  Which  of  these 
posters  do  you  recall  seeing  displayed? 
Please  mark  either  ‘recall’  or  'do  not  recall*  for 
each  poster. 


lit 

r 


I  RECALL  SEEING  THE  POSTER 

I  DO  NOT  RECALL  SEBHO  THE  POSTER 

I 

OOj  Poster  1 
OO  Poster  2 
00  Posters 
00  Poster 4 
00  Poster  5 
00  Poster  6 
00  Poster  7 
00  Posters 
00  Poster 9 
00  Poster  10 
00  Poster  11 
001  Poster  12 


I 

mm 


liboMMoooMoeeoooooooo 


slims  comers  on  on  awes  fry 


I 
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9.  Where  do  you  usually  see  these  potters 
displayed? 

O  Work  Area 

O  Dormitory/Quarters  Area 
O  Dining  Area 
O  Ltorary 
O  Service  Club 

O  Someplace  Else  (please  specify) 

O  I  have  never  seen  them  I 


10.  In  your  judgment,  how  effectively  does  each 
of  these  posters  convey  its  message? 


VERY  EFFECTIVELY 
EFFECTIVELY 
f  INEFFECTIVELY 
I  VERY  MEFFECTIVELY 

|  I  |  I  DO  NOT  RECALL  SEE  WQ  THE  POSTER 


pro  ooi 
ooooo 
ooooo 
ooooo 
ooooo 
ooooo 
ooooo 
ooooo 
ooooo 
ooooo 
ooooo 
1QQ.QQ.01 


Poster  1 
Poster  2 
Poster  3 
Poster  4 
Poster  5 
Posters 
Poster  7 
Poster  8 
Poster  9 
Poster  10 
Poster  11 
Poster  12 


Please  respond  to  questions  11  and  12  on  a 
separate  sheet  of  paper  and  return  it  with  the 
questionnaire. 


11.  Please  list  additional  subjects  you  would 
like  to  see  presented  on  future  Defense 
Billboard  posters. 

OMark  here  if  you  have  listed  any  comments 
or  suggestions. 


12.  Please  share  your  thoughts  on  how  to 
improve  Defense  Billboard  poster 
distribution,  subject  coverage,  method  of 
presentation  or  whatever  comes  to  mind  that 
would  make  the  publication  more  available  or 
useful  to  you. 

OMark  here  if  you  have  submitted  any 
comments  or  suggestions. 
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APPENDIX  n-B 


DESCRIPTIVE  STATISTICS 
BILLBOARD  1989  AUDIENCE  SURVEY 


APPENDIX  ll-B.  DESCRIPTIVE  STATISTICS 
BILLBOARD  1989  AUDIENCE  SURVEY 


(Total 

Number  of  Respondents: 

4525) 

Question 

Response 

Cases 

Percentage 

Q1: 

"My  organization  is... 

Army 

1161 

25.7 

Navy 

1222 

27.1 

Air  Force 

1354 

Marines 

730 

16.2 

DoD  Agency 

22 

0.5 

Other 

20 

0.5 

TOTALS 

4509 

Q2: 

"My  organization  is... 

Active 

4415 

98.3 

Reserve  or  National  Guard 

50 

1.1 

Other 

28 

0.6 

TOTALS 

4493 

100.0 

Q3: 

"My  current  status  is... 

Active  Duty 

4420 

98.8 

Reservist 

21 

0.5 

National  Guard 

1 

* 

Civilian  Employee 

15 

0.3 

Other 

19 

0.4 

TOTALS 

4476 

100.0 

Q4: 

"1  have  accumulated ... 

Four  or  Less 

612 

14.3 

years  of  active,  reserve  and  More  than  Pour 

3654 

85.7 

or  civil  service. 

TOTALS 

4266 

100 

Q5: 

"My  pay  grade  is 

E1-E4 

496 

11.0 

E5-E6 

708 

15.7 

E7-E9 

1451 

32.2 

W1-W4 

200 

4.4 

01-03 

956 

21.2 

04+ 

667 

14.8 

GS3-GS6 

2 

• 

GS7-GS9 

3 

0.1 

GS11+ 

6 

0.1 

Other 

24 

0.5 

TOTALS 

4513 

100.0 

Q6: 

"My  highest  level  of 
education  is... 

Some  High  School 

HS  Graduate  or  GEO 

Some  College 

Bachelor's  Degree 

Master's  Degree 
PhD/Professional  Degree 

TOTALS 

13 

758 

1802 

1104 

617 

153 

4447 

0.3 

17.0 

40.6 

24.8 

13.9 

3.4 

100.0 

Q7: 

"My  present  zip  code 

Europe 

64 

1.4 

atwoik  is... 

Far  East 

124 

2.8 

Other 

164 

3.6 

CONUS 

4173 

92.2 

TOTALS 

100.0 

Q8:  "The  attachments  show  the  12  Defense  Billboard  posters  distributed  over  the  last  year. 


They  are  labeled  Poster  1,  Poster  2,  and  so  on  through  Poster  12.  Which  of  these  posters 
do  you  recall  seeing  displayed?  Please  mark  either  "recall"  or  "do  not  recall"  for  each  poster. 

Question 

Response 

Cases 

Percentage 

1 

"Pride:  Show  It  Everywhere" 

Recall 

1132 

25.0 

(January  1989) 

Don't  Recall 

3312 

73.2 

Date  distributed  in  (  );  not 
indicated  on  poster  broadsheet 

Missing 

81 

1.8 

provided  the  respondent. 

Totals  for  All  Posters 

4525 

100.0 

Reminder:  Mall  Survey  Questionnaire  Distributed  August  1989 

2 

"Little  Scraps  Can  Add  Up 

Recall 

795 

17.6 

A  Whale  of  a  Lot" 

Don't  Recall 

3612 

79.8 

(July  1988) 

Missing 

118 

2.6 

3 

"Do  You  Have  to  Get  Hit  Over 

Recall 

871 

19.3 

the  Head  to  Realize  Ifs  Smart 

Don’t  Recall 

3548 

78.4 

to  Wear  a  Helmet?" 

(June  1989) 

Missing 

106 

2.3 

4 

"Sometimes  the  Hurt  Is  More 

Recall 

1540 

34.0 

Than  Skin  Deep" 

Don't  Recall 

2886 

63.8 

(April  1989) 

Missing 

99 

2.2 

5 

"They  Used  to  Cal  Him 

Recall 

654 

14.5 

Smokey" 

Don't  Retail 

3762 

83.1 

(October  1988) 

Missing 

109 

2.4 

6 

"Did  You  Ever  Wonder 

Recall 

362 

8.0 

How  a  Fly  Could  be  So  Blind" 

Don't  Recall 

4050 

89.5 

(November  1988) 

Missing 

113 

2.5 

n-B-4 


7  "Warning!  Exercise  Can  Cause 

Recall 

961 

21.2 

Visible  Side  Effects" 

Don't  Recall 

3455 

76.4 

(August  1988) 

Missing 

109 

2.4 

8  "Win  the  Fear  of  AIDS 

Recall 

574 

12.7 

Make  You  Eat  Alone?" 

Don't  Recall 

3832 

84.7 

(September  1988) 

Missing 

119 

2.6 

9  "Stake  your  Life  on  the 

Recall 

506 

11.2 

Count" 

Don't  Recall 

3903 

86.3 

(May  1989) 

Missing 

116 

2.6 

1 0  "One  Way  or  Another  You'll 

Recall 

1006 

22.2 

End  Up  With  a  Designated 

Don't  Recall 

3413 

75.4 

Driver" 

Missing 

106 

2.3 

(December  1988) 

1 1  "Hey!  1  Eat  From  the  Four 

Recall 

646 

14.3 

Basic  Food  Groups  daily.” 

Don't  Recall 

3752 

82.9 

(March  1989) 

Missing 

127 

2.8 

1 2  "Look  Where  You've  Been 

Recall 

335 

7.4 

to  See  Where  You're  Going" 

Don't  Recall 

4075 

90.1 

(February  1989) 

Missing 

115 

2.5 

Q9 :  "Where  do  you  usually  see 

Work  Area 

1704 

37.7 

these  posters  displayed? 

Dormitory/Quarters 

55 

1.2 

Dining  Area 

54 

1.2 

Library 

119 

2.6 

Service  Club 

69 

1.5 

Someplace  Else 

327 

7.2 

1  have  never  seen  them 

1608 

35.5 

Multiple  Responses 

462 

10.2 

No  Response  Given 

127 

2.8 

TOTALS 

4525 

100.0 

Q10:  "In  your  judgment  how  effectively  does  each  of  these  posters  convey  its  message? 


Poster  and  Theme 

Response 

Cases 

Percentage 

1  “Pride:  Show  It  Everywhere" 

Very  Effectively 

957 

21.1 

(January  1989) 

Effectively 

1120 

24.8 

Date  dstrftjuted  in  (  ); 

Ineffectively 

164 

3.6 

not  indicated  on  poster 

Very  Ineffectively 

41 

0.9 

broadsheet  provided  the 

1  do  not  recall  seeing 

2056 

45.4 

respondent. 

Missing 

187 

4.2 

Totals  for  All  Posters 

4525 

100.0 

Mean  2.74,  SDV1.73 
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Reminder:  Mall  Survey  Questionnaire  Distributed  August  1989 


"Little  Scraps  Can  Add  Up 
A  Whale  of  a  Lot" 

(July  1988) 


"Do  You  Have  to  Get  Hit 
Over  the  Head  to  Realize 
Smart  to  Wear  a  Helmet?" 
(June  1989) 


"Sometimes  the  Hurt 
Is  More  Than  Skin  Deep" 
(April  1989) 


"They  Used  to  Call  Him 
Smokey" 

(October  1988) 


"Did  You  Ever  Wonder  How 
a  Fly  Could  be  So  Blind" 
(Nov  1988) 


"Warning!  Exercise 
Can  Cause  Visfcle  Side 
Effects"  (August  1988) 


Very  Effectively 

371 

8.2 

Effectively 

987 

21.8 

Ineffectively 

498 

11.0 

Very  Ineffectively 

193 

4.3 

1  do  not  recall  seeing 

2235 

49.4 

Missing 

241 

5.3 

Mean  2.32,  SDV  1.50 

Very  Effectively 

861 

19.0 

Effectively 

1003 

22.2 

Ineffectively 

181 

4.0 

Very  Ineffectively 

56 

1.2 

1  do  not  recall  seeing 

2194 

48.5 

Missing 

230 

5.1 

Mean  2.60,  SDV  1.71 

Very  Effectively 

1260 

27.8 

Effectively 

1032 

22.8 

Ineffectively 

172 

3.8 

Very  Ineffectively 

52 

1.1 

1  do  not  recall  seeing 

1795 

39.7 

Missing 

214 

4.8 

Mean  2.98,  SDV  1.76 

Very  Effectively 

306 

6.8 

Effectively 

867 

19.2 

Ineffectively 

533 

11.8 

Very  Ineffectively 

205 

4.5 

1  do  not  recall  seeing 

2369 

52.4 

Missing 

245 

5.3 

Mean  2.19,  SDV  1.45 

Very  Effectively 

289 

6.4 

Effectively 

701 

15.5 

Ineffectively 

529 

11.7 

Very  Ineffectively 

208 

4.6 

1  do  not  recall  seeing 

2539 

56.1 

Missing 

259 

5.7 

Mean  2.06,  SDV  1.41 

Very  Effectively 

479 

10.6 

Effectively 

1060 

23.4 

Ineffectively 

421 

9.3 

Very  Ineffectively 

165 

3.6 

1  do  not  recan  seeing 

2157 

47.7 

Missing 

Mean  2.43,  SDV  1 .56 

243 

5.4 

8  "Will  the  Fear  of  AIDS 

Very  Effectively 

479 

10.6 

Make  You  Eat  Alone?" 

Effectively 

903 

20.0 

(September  1988) 

Ineffectively 

390 

8.6 

Very  Ineffectively 

107 

2.4 

1  do  not  recall  seeing 

2398 

53.0 

Missing 

Mean  2.29,  SDV  1.56 

248 

5.5 

9  "Stake  your  Life  on  the 

Very  Effectively 

301 

6.7 

Count"  (May  1989) 

Effectively 

865 

19.1 

Ineffectively 

502 

11.1 

Very  Ineffectively 

162 

3.6 

1  do  not  recall  seeing 

2446 

54.0 

Missing 

Mean  2.16,  SDV  1.45 

249 

5.5 

1 0  "One  Way  or  Another  You’ll 

Very  Effectively 

1302 

28.8 

End  Up  With  a  Designated 

Effectively 

663 

14.7 

Driver" 

Ineffectively 

139 

3.1 

(December  1988) 

Very  Ineffectively 

59 

1.3 

1  do  not  recall  seeing 

2122 

46.9 

Missing 

Mean  2.76,  SDV  1.82 

240 

5.3 

1 1  "Hey!  1  Eat  From  the  Four 

Very  Effectively 

356 

7.9 

Basic  Food  Groups  daily." 

Effectively 

820 

18.1 

(March  1989) 

Ineffectively 

548 

12.1 

Very  Ineffectively 

197 

4.4 

1  do  not  recall  seeing 

2347 

51.9 

Missing 

Mean  2.21,  SDV  1.47 

257 

5.7 

1 2  "Look  Where  You’ve  Been 

Very  Effectively 

503 

11.1 

to  See  Where  You're  Going’ 

Effectively 

817 

18.1 

(February  1989) 

Ineffectively 

282 

6.2 

Very  Ineffectively 

31 

2.9 

1  do  not  recall  seeing 

2534 

56.0 

Missing 

Mean  2.21,  SDV  1.56 

258 

5.7 

Q 1 1 :  "Name  additional  subjects 

Comments 

544 

12.0 

you  would  Ike  presented 
on  posters." 

Q  12:  "Provide  thoughts  on  how 

Comments 

548 

12.1 

to  improve  poster  distribution, 
subject  coverage,  method  of 
presentation." 
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APPENDIX  II-C 


BILLBOARD  COMMENTS 
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APPENDIX  \\~C— BILLBOARD  COMMENTS 


QUESTION  11 
DRUG/ALCOHOL  ISSUES 

anti-drug  112 

alcohol  abuse  34 

drinking  and  driving  27 

anti-cocaine/crack  8 

criminal  aspects  of  drug/alcoho!  abuse  4 

aids  and  drug  abuse  3 

steroid  use  3 

effects  of  abuse  on  family  3 

depiction  of  abusive  lifestyle  3 

drug  testing  program  2 

prescription  drug  abuse  2 

kids  and  drugs  2 

workplace  1 

provide  role  models  1 

drug  free  zones  1 

drug  tolerance  1 

drug  use  in  schools  1 

helping  co-worker  with  addiction  1 

drugs  and  children  1 

alternatives  to  parties  1 

use  of  army  in  war  on  drugs  1 

drugs  and  unborn  1 

alternatives  to  alcohol  at  social  gatherings  _ 1 

Total  214 
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HEALTH  ISSUES 


anti-smoking  1 9 

sale  sex 

physical  fitness  1 7 

good  eating  habits  1 4 

controlling  stress  1 2 

AIDS  prevention  1 2 

sexually  transmitted  diseases  1 1 

birth  control  1 0 

chewing  tobacco  dangers  1 0 

family  planning  for  singles  3 

mental  illness  3 

overweight  military  members  3 

unwanted/teen  pregnancy  3 

CPR  3 

heat  stress  2 

cholesterol  education  2 

exercise  and  caloric  consumption  2 

health  in  general  2 

AIDS  and  sailors  on  Oberty  2 

personal  hygiene  2 

donate  blood  2 

mecficai/dentai  care  2 


hypertension  2 

heart  attack/stroke  1 

aerobic  exercise  1 

recognizing  depression  1 

getting  enough  steep  1 

smoking  in  office  areas  1 

positive  reinforcement  in  weight  loss  1 

sun  exposure  1 

relaxation  — 1 

Total  164 


n-C-4 


PERSONAL  GROWTH/CAREER  ADVANCEMENT 


education  43 

leadership  1 1 

teamwork  9 

advancement/career  planning  5 

duty  as  career  4 

fraternization  4 

military  and  professional  development  4 

self  esteem  3 

professionalism  3 

knowing  your  job  3 

respect  for  authority  3 

MOS  posters  3 

positive  attitude  3 

responsibility  3 

reenlistment  2 

how  promotions  boards  work  2 

why  raises  are  so  smaf  2 

Mustration  of  chain  of  command  2 

code  of  conduct  2 

employee  relations  2 

being  a  friend  2 

congressional  support  for  pay  raises  2 

role  of  seff  discipline  in  advancement  1 

choosing  reaKstic  goals  1 

failure  due  to  lack  of  confidence  1 

importance  of  being  prompt  1 

Me  after  retirement  1 

pulling  own  weight  to  accomplish  mission  1 

advancing  through  education  1 

saiuting-required  and  desired  1 

pay  1 

promotion  1 

personal  gain  1 

property  accountabiRy  1 

n-c-5 


accepting  defeat  maturely  1 

mtttary  v.  dviian  living  standard  1 

creative  problem  solving  1 

common  sense  1 

reporting  problems  1 

computer  literacy  1 

writing  wefl  1 

Total  136 

OTHER 

sexual  harassment  1 7 

suicide  prevention  1 3 

community  involve  me nt/volunteerism  1 2 

voting  1 1 

rape  awareness/prevention  6 

courtesy  5 

religion  5 

crime  5 

reprint  of  old  WWIi  posters  5 

tteracy  * 

car  maintenance  3 

housing  on  post  3 

negative  impact  of  gossip  3 

sports  2 

respect  for  others  property  2 

pubic  service  2 

value  of  good  human  relations  2 

unusual  sports  2 

NavyreMef  2 

needs  of  singles  2 

spiritual  readiness  2 

pets,  bugs  and  rats  in  housing  1 

use  of  profanfty  1 

pubic  transportation  1 
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ft 

Christ  and  the  constitution 

i 

> 

abortion 

i 

being  street  smart 

i 

DoD  hotline 

i 

DoD  suggestion  program 

i 

> 

quaftyof  life 

i 

brotherhood 

i 

contribute  to  CFC 

i 

science 

i 

1 

geography 

i 

space 

i 

importance  of  civilian  DoD  personnel 

i 

homosexuality 

i 

1 

pornography 

i 

deter  Satan  worship 

i 

Berlin  wal 

i 

confidentiality 

i 

ft 

human  relations 

i 

ships  at  sea 

i 

dvttan  support 

i 

treating  subortfnates  equally 

i 

1 

controlling  anger 

_ i 

Total 

133 

► 

PATRIOTISM/PRIDE 

integrity/pride 

29 

patriotisrrVTIag 

24 

pride  in  uniform 

8 

► 

pride  in  Job 

7 

mttary  history 

7 

pride  in  service 

6 

price  of  freedom 

5 

I 

pride  In  appearance  and  actions 

4 

pride  and  professiontfsm 

4 

r 

n-c-7 

gratitude  to  those  who  served/sacrificed  3 

flag  burning  3 

army  history  2 

appreciation  for  overseas  personnel  2 

loyalty  2 

contributions  of  armed  forces  2 


pride  for  reserves  1 

pride  in  increased  responsfoility  1 

history  of  battles  won  and  lost  1 

military  milestones  1 

women  in  uniform  1 

duty/honor/country  1 

NCO  contributions  1 

mffltary  museums  1 

appreciation  1 

spirit  of  freedom  1 

warrior  1 

Navy  history  1 

medal  of  honor  recipients  1 

a  series  on  the  constitution  1 

Air  Force  history  1 

Total  123 


MILIT ARY/SECURITY  ISSUES 


waste,  fraud  and  abuse  of  funds  25 

espionage/safeguard  information  22 

security  12 

terrorism  awareness  8 

communications  security  5 

mMary  benefits  5 

unity  among  service  branches  4 

combat  readftess  4 

pubfic  opinion  of  host  countries  to 

USpresence  3 


n-c-8 


fr 


I 


I 


I 


» 


I 


compusec 

BOSS 

POWs 

software  theft 

doing  more  with  less-budget  cuts 

international  relations 

Navy  issues 

OPSEC 

base  security 

military  rights  and  respo  ns  abilities 
MIA's 

ethics  in  procurement 
military  courtesy 
unity  among  allies 
bomb  threats 
protecting  freedom 
warfightingl 
future  Air  Force 
recruiting 

double  standards  within  DoD 
Total 


3 

3 

3 

2 

2 

3 

2 

2 

1 

1 

1 

1 

1 

1 

1 

1 


120 


FAMILY  ISSUES 


spouse  abuse  29 

p  child  abuse  22 

recognition  of  family  1 3 

family  tog  et  he  mess/support  1 1 

available  programs  6 

p  chfldcare  3 

parental  involvement  3 

miltary  family  Sfestyte  3 

preventing  child  kidnapping  3 

I  thinking  of  famfly  when  away  3 

famNy  separation  3 

n-C-9 


9 


4 


wtts  2 

single  parenting  2 

child  development  centers  2 

taking  care  of  family  before  deploy  2 

adultery  2 

parental  disciplining  1 

children  and  strangers  1 

protecting  children  from  strangers  1 

medtealcare  1 

dealing  with  divorce  1 

pet  neglect  jl 

Total  115 


SAFETY  ISSUES 

safe  driving  17 

seat  belt  use  17 

safety  on  and  off  Job  11 

in  general  1 0 

fire  prevention  5 

child  car  seats  5 

water  safety  4 

motorcycle  3 

electrical  3 

bicycle  safety  3 

helmet  3 

fire  escape  awareness  2 

crime  prevention  2 

avokSng  accidents  2 

auto  driver  awareness  of  motorcycles  2 

sports  2 

industrial  1 

hazards  of  shit  work  1 

preventing  back  Injury  1 

smoke  alarms  i 


n-c-io 


swimming  alone  1 

safe  exercise  1 

heat  and  cold  safety  1 

falling  asleep  at  wheel  1 

firearms  while  hunting  1 

swimming  accidents  1 

eye  protection  during  sports  1 

provide  emergency  and  social  service 

phone  numbers  1 

POV  safety  1 

young  v.  mature  thinking  1 

military  vehicles  1 

lawn  mower  1 

tools  1 

toys  1 

weapons  1 

equipment  maintenancel 

aviation  1 

Total  112 


ETHNIC/RACIAL/SPECIAL  INTEREST  CONCERNS 


discrimination  14 

Hispanic  contribution  1 2 

racial  harmony  9 

racial/sexual  equality  6 

importance  and  roles  of  women  in  military  5 

other  ethnic  contributions  5 

equal  opportunity  3 

blacks  in  mittary  3 

Asian/pacific  history  3 

EEO  promotion  2 

tolerance  of  others- racial,  ethnic,  religious  2 
white  history  2 

non-Mexican  Hispanics  1 


harmony  between  sexes  at  work  1 

emphasis  on  racial  unity  as  Americans  1 

explaining  human  rights  1 

Native  American  history  1 

women's  history  1 

reverse  discrimination  _J. 

Total  73 

FINANCIAL/CONSUMER  ISSUES 
financial  planning/management  1 2 

credit/being  in  debt  6 

US  savings  bonds  5 

saving  money  4 

bad  checks  3 

proper  insurance  2 

check  cashing  2 

avoiding  scams  1 

advice  for  car  buyers  1 

overseas  black  market  1 

balancing  check  book  _1 

Total  38 

ENVIRONMENTAL  ISSUES 

environmental  awareness  5 

hazardous  waste  5 

anti-fitter  4 

energy  conservation  3 

recycling  3 

anti-pollution  3 

wflcKfe  conservation  1 

ridesharing  1 

noise  pollution  1 


n-c-12 


ft 

dept  of  energy 

1 

1 

dumping  plastics  at  sea 

1 

weather 

-L 

Total 

29 

1 

QUESTION  11 

DISTRIBUTION/DISPLAY 

ft 

widen  distortion  in  general 

54 

find  new  distribution  method 

36 

place  in  public  areas 

24 

1 

distribute  to  all  units 

22 

send  a  catalog  of  posters 

20 

distorts  to  work  areas 

17 

distribute  to  squadrons 

16 

ft 

present  in  appropriate  DoD  magazines 

13 

distribute  overseas 

13 

send  more  than  one  copy 

13 

post  in  dining  facilities 

12 

ft 

distribute  to  public  affairs  officers 

11 

distribute  to  safety  monitors 

10 

post  in  stores/exchanges 

10 

distribute  to  head  of  command 

10 

ft 

display  in  medical  facilities/waiting  rooms 

9 

post  on  large  bUboards 

9 

include  a  frame  (required  at  some  places) 

8 

make  display  mandatory 

8 

» 

use  in  local  base  publications 

7 

display  in  passageways 

5 

include  posters  in  newsreels 

5 

post  in  post  offices 

5 

► 

dfetrtoute  to  fibraries 

5 

dtetribute  to  ships 

5 

I 
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distribute  to  training  sections  4 

display  in  recreation  centers  4 

send  through  each  service  publication  center  4 
post  in  clubs  4 

select  a  post  of  the  month  3 

use  on  TV  3 

have  receiver  sign  to  ensure  delivery  2 

display  in  areas  pertaining  to  the  subject  2 

display  in  bathrooms  2 

designate  a  billboard  for  display  2 

include  as  35mm  slides  for  briefings  2 

distribute  through  more  than  one  channel  1 

use  on  envelopes  1 

use  on  folder  covers  1 

include  as  leaflets  in  pay  1 

distribute  to  chaplains  1 

send  letter  to  accompany  1 

distribute  to  all  recruiters  1 

distribute  to  ROTC  1 

post  in  barber  shops  1 

post  in  ship  stores  1 

improve  visfoiltty  1 

distribute  to  career  counselors  _ 1 

Total  391 


APPEARANCE 

emphasize  pictures  over  words  5 1 

make  more  eye  catching/graphic/direct  29 

increase  size  of  print  24 

keep  simple,  colorful  1 5 

make  message  more  blunt  15 

harder  message  to  get  attention  1 4 

make  posters  more  realistic  12 

increase  bright  colore  1 2 

n-c-i4 


make  more  artistic/oontemporary  1 0 

use  photos  7 

too  cartoonish  7 

too  busy  6 

reduce  dark  colors  6 

include  short  sayings  5 

picture  and  message  must  be  compatible  4 

offer  smaller  version  4 

use  bold  type  on  key  words  in  message  3 

make  3D  2 

use  action  photos  2 

enlarge  and  post  at  front  gate  1 

include  a  written  message  1 

use  celebrity  endorsements  1 

Total  231 

OPINIONS 

very  effective  43 

discontinue  program/invest  $  elsewhere  21 

message  not  always  dear  1 0 

subject  coverage  seems  adequate  8 

high  quality  8 

clever/interesting  7 

ineffective/meaningless  5 

target  younger  troops  5 

send  a  reduced  set  to  allow  selection  5 

provide  brochures  on  poster  topics  5 

allow  comments  where  displayed  3 

too  corny  3 

too  many  posters  already  3 

tailor  the  posters  more  to  each  situation  1 

give  feedback  of  survey  results  1 

conduct  classes  on  bilboard  topics  1 

do  spot  checks  to  assure  quality  control  1 

n-c-15 


posters  are  needed 
target  audience  unclear 
have  little  time  to  read  material 
boring 

use  safety  posters  as  training  aid 
excellent  coverage  of  subject  matter 
Total 


136 


SUBJECT  MATTER 

keep  up  with  current  issues  8 

present  in  a  more  positive  way  3 

address  racial  harmony,  not  separateness  2 

choose  subjects  more  DoD  related  2 

address  subjects  important  to  younger  troops  2 

provide  a  story  on  the  poster  1 

provide  a  recurring  theme  of  importance 

of  dv.  and  mil.  services  1 

use  ads  from  AFRTS  1 

address  more  history  1 

stress  more  sacrifices  of  field  personnel  1 

address  preventable  accidents  1 

include  stats  on  safety  posters  1 

don’t  depict  unresearched  topics  1 

have  variety  of  topics  1 

tailor  each  subject  to  each  military  branch  1 

more  "Wood  and  guts"  1 

avoid  patronizing  1 

no  more  on  safe  sex  1 

avoid  cliches  1 

include  more  reservists  1 
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target  children 

treat  certain  subjects  more  seriously 


1 


Total  34 

NEVER  SEEN  105 

WOULD  LIKE  TO  RECEIVE  34 

RARELY  SEEN  30 

UNNECESSARY  CATEGORY  ON  #1 0  10 
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APPENDIX  III-A 


PRESS  AND  ART  PACK  QUESTIONNAIRE 


m-A-i 


SURVEY  OF  EDITORS  WHO  RECEIVE  PRESS  AND  ART  PACK  Rcs*»-pa<odi«3 

1.  My  organization  is:  (mark  one)  i  8.  My  publication  Is  published  and  distributed: 

O  Army  O  Coast  Guard  ODaily  O  Bi-monthly 


O  Navy 
O  Air  Force 
O  Marines 


O  DoD  Agency/Activity 
O  Other,  Specify 


O  Weekly 
O  Bi-weekly 
O  Monthly 


O  Quarterly 
O  Other,  Specify 


2.  My  organization  is:  (mark  one) 
O  Active 

O  Reserve  or  National  Guard 
O  Other,  Specify  | 


9.  The _ decides  which  articles  from 

Press  and  Art  Pack  will  be  used  In  my 
publication: 

O  Commander  O  Editor 

O  Public  Affairs  Officer  O  Other,  Specify 


3.  My  current  status  is:  (mark  all  that  apply) 


OActive  Duty 
O  Reservist 
O  National  Guard 


O  Civilian  Employee 
O  Other,  Specify 


4.  My  pay  grade  is:  (mark  all  that  apply) 
Enlisted  Civilian 

OE1-E6  CGS1-GS7 

OE7-E9  OGS9  or  above 


10.  My  target  audience  (Including  families  and 
civilian  employees  as  applicable)  is: 

O  Less  than  2,000  015,001-25,000 

02,000-5,000  O More  than 25, 000 

O  5.001  - 15,000 


11.  I  find  that  Pr 


ss  and  Art  Pack  articles  are 
time  sensitive. 


Officer 

OW1-W4 
001-03 
004  or  above 


OOther.  Specify 


O  Almost  always 
O  Sometimes 


O  Never 


My  highest  level  of  education  is: 
O  High  school  graduate  or  GED 
O  Some  college 
O  Bachelor's  degree 
O  Master's  degree 
O  Ph.DVprofessional  degree 

My  present  zip  coda  at  work  is: 


12.  I _ receive  time  sensitive 

material  early  enough  to  include  it  in  my 
publication. 


2  Almost  always 

3  Sometimes 


■  Never 


13.  t  find  the  time  sensitive  articles  sent  out 
through  the  telecommunications  center 
system  as  messages  to  be _ useful. 


li  your  ap  ooda  ha*  only  5  dgit*.  biacfcan  nrrtt  to  indteaw  twm 
in  Mi  Mock  Mow:  1 9  digit*,  eentnua  in  tw  right  block. 


O  Almost  always 
O  Sometimes 


C  Never 
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14.  I  use 


of  the  artwork  in  each 


OA1I  or  almost  aB 
QMore  than  half 


O  Less  than  half 
O  None  or  almost  none 


15.  I  use. 


.of  the  copy  In  each 


7.  My  publication  is  distributed: 

OOn  a  base  or  installation  in  CONUS 
OOn  a  base  or  installation  overseas 
O  Aboard  ship  ________ 

OOther,  Specify  |  . 


mum 


O  Ail  or  almost  all 
QMore  than  half 


later  use. 

O  Almost  always 
O  Sometimes 


O  Less  than  half 
O  None  or  almost  none 


for  possible 


O  Never 


M  Me] 


SUMS  CONTMUt  ON  OTHBt  SBC 


17.  The  amount  of  material  I  need  from  Press  and 
Art  Pack  to  serve  each  of  the  following  groups 
is:  ( mark  the  proper  amount  for  each  group) 


24.  I _ use  the  halftone  reproductions 

provided  in  Praund  AH  Pick. 


a.  Active  Duly  Personnel 

b.  ReeeivelsAjuardsmon 

c.  Civiien  Employees 

d.  Dtptndonti 

e.  Retirees 


ABOUT  THE  SAME 


ui, 

OOOi 

ooo 

ooo 

OOO! 

20^ 


18.  I  would  like  to  see  each  of  Press  and  Art 
Pock's  five  standing  features:  (mark  one  in 
each  row) 


CANCEL 
LESS  OFTEN 
ABOUT  AS  OFTEN 
MORE  OFTEN  I 


a.  National  Detanse  (National  security 
pokey,  new  programs  orignaled  «i  tie 
Department  of  Detente.  speech  excerpt 
by  DoDoAiaak) 

b  Worth  Repeating  (Quotable  quotes). 

c.  On  This  Dale  (Signiticam  dales/events). 

A.  Do  You  Know  (6-8  rmsoekaneous  lads, 
usually  witn  numerical  'answers') 

e  Between  tne  Lines  (Tips  ter  writers  and 


WCEL 

11 


00  00 


oooo 

oooo 

oooo 

iQQ.Q.0 


18  Press  and  Art  Peck _ covers  the 

same  editorial  material  received  from  my 
service  or  other  sources. 

r  Almost  always  O  Never 

C  Sometimes 


0  Almost  always  C  Never 
0  Sometimes 


25.  The  amount  of  artwork  provided  in  Ptmi 
and  Art  Pack  should: 

0  Be  increased 
0  Remain  about  the  same 
O  Be  decreased 


26.  When  each  of  the  following  types  of  art 
appears  in  Press  and  Art  Pack,  huse  it  for  my 
publication:  (mark  the  one  best  response  tor 
each  type  of  art) 


ALMOST  ALWAYS 

|  SOMETIMES 

|  NEVER 

a  MStary  Hardware 

ooo 

r  Tacbcal-Fidd  Scenes 

ooo 

c  Domesbc'Censumer 

ooo 

t  e«ne*s/Heal!h 

ooo 

■  Duty  (Lite 

ooo, 

L  Dngbas 

ooo 

g  Piemebonelrtaeaenal  An 

QQQ 

t  Scorts^acvMton 

20.  I  use  Press  and  Art  Pack  articlas: 

2  '  In  nearly  every  issue  of  my  publication 
O  Occasionally 
0  Never 


27.  I _ .  find  the  Production  Tips 

material  to  be  useful. 

O  Almost  always  O  Never 

O  Sometimes 


l 


21-  Press  and  Art  Pack  articles  should  be: 

O  Much  longer  O  Somewhat  shorter 

O  Somewhat  longer  O  Much  shorter 
C  About  the  same 


22.  Press  and  Art  Pack _ covers  the 

same  art  material  received  from  my 
service  or  other  source. 

C  Almost  always  O  Never 

O  Sometimes 


23.  I  use  Press  and  Art  Pack  artwork: 

O  In  nearly  every  issue  of  my  publication 
O  Occasionally 
O  Never 


28.  As  an  overseas  edftor,l  usa__of  the 
Combined  Federal  Campaign-Overseas 
Area  copy/artworfc  that  Is  Included  annuelly 

m  the  issue  before  each  campaign  period.  # 

O  AH  or  almost  al  Owssfianhalf 
O  More  than  half  O  None  or  almost  none 

29.  Are  there  other  types  of  art  or  oopy  that 

should  be  provided  In  ftwt Jfflt  M  Pi m 
Please  Usl  on  a  separate  sheet.  In  adOnon,  w 

please  take  the  time  to  share  any  other 
thoughts  you  may  have  on  how  to  make  rtlia 
and  Art  Pack  more  available  or  useful  to  you. 

N 

C  Mark  hem  H  you  have  submitted  any 
comments  or  suggestions.  ^ 


THANK  YOU  FOR  YOUR  SUPPORT  AND  FftOFEMNONALJNSlQHT 


m-A-4 
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APPENDIX  lll-B.  DESCRIPTIVE  STATISTICS  FOR  PRESS  AND  ART  PACK 

1989  EDITORS  SURVEY 
(Number  of  Respondents:  921) 


Question 

Response 

Cases 

Percentage 

Q1 :  "My  organization  is... 

Army 

280 

Navy 

287 

31.7 

Air  Force 

183 

20.2 

Marines 

31 

3.4 

Coast  Guard 

35 

3.9 

DoD  Agency 

45 

5.0 

Other 

44 

4.9 

Q2 :  "My  organization  is... 

Active 

611 

67.7 

Reserve  or  National  Guard  >> 

181 

20.1 

Other 

110 

12.2 

Q3:  "My  current  status  is... 

Active  Duty 

385 

44.7 

Reservist 

31 

3.6 

National  Guard 

61 

7.1 

Civilian 

356 

41.3 

Other 

29 

3.3 

Q4;  "My  pay  grade  Is 

E1-E6 

301 

34.6 

E7-E9 

71 

8.2 

W1-W4 

6 

0.7 

01-03 

65 

7.5 

04+ 

43 

4.9 

GS1-GS7 

69 

7.9 

GS9+ 

284 

32.6 

Other  (7) 

32 

3.6 

Mean  4.14,  SDV  2.73 

Q5:  "My  highest  level  of 

Some  High  School  (1) 

education  is... 

Graduate/GED 

48 

5.3 

Some  College 

396 

41.2 

Bachelor's  Degree 

351 

38.5 

Master's  Degree 

128 

14.0 

Ph  D/Prof essional  (5) 

9 

1.0 

Mean  2.64,  SDV  0.82 

06:  "My  present  zip  code 

CONUS 

865 

93.9 

at  work  Is... 

Europe 

19 

2.1 

Far  East 

20 

2.2 

Other 

17 

1.8 

Q7:  My  publication  is 
distributed... 


On  a  base  on  installation 

in  CONUS 

430 

49.0 

Overseas 

121 

13.8 

Aboard  Ship 

24 

2.7 

Other 

303 

34.5 

Q8:  My  publication  is  published 
and  distributed... 

Daily  (1) 

Weekly 

Bi-weekly 

Monthly 

Bi-monthly 

Quarterly 

Other  (7) 

Mean  3.85,  SDV  1.44 

28 

113 

101 

346 

78 

207 

18 

3.1 

12.7 

11.3 

38.8 

8.8 

23.2 

2.0 

Q9:  "The  decides  which 

Commander 

10 

1.2 

articles  from  Press  and  Art 

Public  Affairs  Officer 

125 

14.4 

Pack  wil  be  used  in  my 

Editor 

693 

79.7 

publication. 

Other 

41 

4.7 

Q10:  "My  target  audience 

<than  2,000  (1) 

334 

36.9 

(including  families  and 

2,000-5,000 

228 

25.2 

civilian  employees) 

5,001-15,000 

197 

21.7 

15,001-25,000 

61 

6.7 

>  25,000  (5) 

86 

9.5 

Mean  2.27,  SDV  1 28 

Q11:  "1  find  that  Press  and  Art 

Pack  articles  are _ 

time  sensitive. 

Almost  Always  (3) 
Sometimes 

Never (1) 

Mean  2.41 ,  SDV  0.52 

388 

511 

11 

42.6 

56.2 

1.2 

• 

Q12:  "1 _ receive  time  sensitive 

Almost  Always 

515 

56.7 

materia]  early  enough  to 

Sometimes 

366 

40.3 

include  it  in  my  publication. 

Never 

27 

3.0 

• 

Mean  2.54,  SDV  0.56 

Q13:  "1  find  the  time  sensitive 

Almost  Always 

187 

22.4 

articles  sent  out  through 

Sometimes 

551 

65.9 

the  telecommunications 

Never 

98 

11.7 

center  system  as  messages 
to  be _ useful. 


Mean  2.11,  SDV  0.57 


I 


Q14:  "I  use _ of  the  artwork 

All  or  Almost  All  (4) 

16 

1.8 

In  each  P&A  Pack. 

More  than  half 

134 

14.7 

Less  than  half 

551 

60.5 

None  or  almost  none  (1) 

210 

23.0 

Mean  1.95,  SDV  0.67 


1 

Q1 5 :  "1  use _ of  the  copy 

in  each  P&A  Pack. 

All  or  Almost  All 

More  than  half 

Less  than  half 

None  or  almost  none 

Mean  1.92,  SDV  0.58 

11 

84 

636 

179 

1.2 

9.2 

69.9 

19.7 

» 

Q16:  "1  file  P&A  Pack  for 

Almost  Always 

724 

79.6 

possible  later  use. 

Sometimes 

160 

17.6 

Never 

25 

2.8 

Mean  2.77,  SDV  0.48 

> 

Q1 7:  "The  amount  of  material  1  need  from  P&A  Pack  to  serve  each  of  the  following  groups  is: 

a.  Active  Duty  Personnel 

Less  (1) 

166 

20.1 

More  (3) 

211 

25.5 

Same  (2) 

449 

54.5 

Mean  2.05,  SDV  0.67 

i 

b.  Reservists/Guardsmen 

Less 

338 

42.3 

More 

190 

23.8 

Same 

271 

33.9 

Mean  1.82,  SDV  0.79 

1 

c.  Civilian  Employees 

Less 

182 

22.4 

More 

279 

34.3 

Same 

353 

43.4 

Mean  2.12,  SDV  0.74 

d.  Dependents 

Less 

190 

24.0 

More 

207 

26.2 

w 

Same 

394 

49.8 

Mean  2.02,  SDV  0.71 

e.  Retirees 

Less 

303 

39.2 

More 

138 

17.9 

> 

Same 

331 

42.9 

Mean  1.79,  SDV  0.73 

i 

m-B-5 


> 


Qi  8:  "I  would  like  to  see  each  of  P&A  Packs  five  standing  features. 


a.  National  Defense 

Cancel  (1) 

38 

4.3 

Less  often  (3) 

153 

17.2 

About  as  Often  (2) 

495 

55.7 

More  Often  (4) 

202 

22.7 

Mean  2.97,  SDV  0.76 

b.  Worth  Repeating 

Cancel 

108 

12.3 

Less  Often 

185 

20.8 

About  as  Often 

483 

54.4 

More  Often 

111 

12.5 

Mean  2.67,  SDV  0.85 

c.  On  This  Date 

Cancel 

89 

10.1 

Less  Often 

157 

17.8 

About  as  Often 

511 

57.8 

More  Often 

127 

14.4 

Mean  2.76,  SDV  0.82 

d.  Do  You  Know 

Cancel 

126 

14.3 

Less  Often 

235 

26.6 

About  as  Often 

440 

49.9 

More  Often 

81 

9.2 

Mean  2.54,  SDV  0.85 

e.  Between  The  Lines 

Cancel 

29 

3.2 

Less  Often 

64 

7.2 

About  as  Often 

361 

40.4 

More  Often 

439 

49.2 

Mean  3.36,  SDV  0.75 

Q19:  "P&A  Pack _ covers  the 

Almost  Always 

53 

7.4 

same  editorial  material 

Sometimes 

662 

92.6 

received  from  my 

Never 

0 

0 

service  or  other  sources. 

Mean  2.07,  SDV  0.26 

Q20:  "1  use  PSA  Pack  articles 

In  nearly  every  issue  of 

my  publication 

332 

36.8 

Occasionally 

533 

59.0 

Never 

38 

4.2 

Mean  2.33,  SDV  0.90 

m-B-6 


I 


"P&A  Pack  articles  should 

Much  longer  (5) 

4 

0.4 

be 

Somewhat  longer 

14 

1.6 

About  the  same 

549 

61 .0 

Somewhat  shorter 

276 

30.7 

Much  shorter  (1) 

57 

6.3 

Mean  2.59,  SDV  0.65 

I  022:  " P&APack _ covers  No  responses 

the  same  art  material 
received  from  my  service 
or  other  sources 


Q23:  "1  use  P&A  Pack  artwork 

In  nearly  every  issue  of 

279 

30.9 

my  publication 
Occasionally 

559 

61.8 

Never 

66 

7.3 

Mean  2.74,  SDV  0.57 

ft 

Q24:  "1  use  the  halftone 

Almost  Always 

43 

4.8 

reproductions  provided 

Sometimes 

544 

60.2 

in  P&A  Pack. 

Never 

316 

35.0 

Mean  1.70,  SDV  0.55 

» 

Q25:  The  amount  of  artwork 

Be  increased  (3) 

442 

49.3 

provided  in  P&A  Pack 

Remain  about  the  same 

407 

45.4 

should 

Be  decreased  (1) 

Mean  2.44,  SDV  0.59 

48 

5.4 

ft 

Q26:  "When  each  of  the  following  types  of  art  appears  In  P&A  Pack,  1  use  it  for  my  publication 

a.  Military  Hardware 

Almost  Always  (3) 

77 

8.8 

Sometimes 

444 

50.9 

Never  (1) 

351 

40.3 

ft 

b.  Tactical/Field  Scenes 

Mean  1.69,  SDV  0.63 

Almost  Always 

65 

7.5 

Sometimes 

333 

38.3 

Never 

471 

54.2 

Mean  1.53,  SDV  0.63 

ft 

c.  Domestic/Consumer 

Almost  Always 

112 

12.8 

Somtimes 

542 

62.2 

Never 

218 

25.0 

Mean  1.88,  SDV  0.60 


ft 


ft 


m-B-7 


d.  Fitness/Health 

Almost  Always 

245 

27.5 

Sometimes 

535 

60.1 

Never 

218 

25.0 

Mean  2.15,  SDV  0.61 

e.  Duty/Life 

Almost  Always 

122 

14.1 

Sometimes 

479 

55.5 

Never 

262 

30.4 

Mean  1.84,  SDV  0.65 

f.  Dingbats 

Almost  Always 

65 

7.6 

Sometimes 

325 

38.1 

Never 

462 

54.2 

Mean  1.53,  SDV  0.63 

g.  Promotional/ 

Almost  Always 

331 

37.4 

Seasonal  Art 

Sometimes 

432 

48.9 

Never 

121 

13.7 

Mean  2.24,  SDV  0.68 

h.  Sports/Recreation 

Almost  Always 

172 

19.7 

Sometimes 

516 

59.0 

Never 

186 

21.3 

Mean  1.98,  SDV  0.64 

Q27:  *1 _ find  tne  production 

Almost  Always 

383 

42.7 

tips  material  to  be 

Sometimes 

452 

50.4 

Never 

61 

6.9 

Mean  2.36,  SDV  0.61 

Q28:  "As  an  overseas  editor, 

Ail  or  almost  afl  (4) 

19 

6.0 

1  use _ of  the  Combined 

More  than  half 

51 

16.1 

Federal  Campaign- 

Less  than  half 

106 

33.5 

Overseas  Area  copy/ 

None  or  almost  none  (1) 

140 

44.4 

artwork  that  is  included 
annually  in  the  issue 
before  each  campaign 

period.  Mean  1.84,  SDV  0.91 


Q29 :  "Are  there  other  types  of  art  or  copy  that  should  be  provided  in  P&A  Pact c?  Please  list  on  a 
separate  sheet.  In  addition,  please  take  the  time  to  share  any  other  thoughts  you  may 
have  on  how  to  make  P&A  Pack  more  available  or  useful  to  you. 

Comments  made  159  17.3 


ffl-B-8 


APPENDIX  m-C 


PRESS  AND  ART  PACK  COMMENTS 


ffl-C-1 


PRESS  AND  ART  PACK  COMMENTS 


ART 

Need  art  in  the  following  topics/areas: 

Coast  Guard  1 0 

seasonal  7 

Navy  7 

emblems,  insignia,  flag  6 

Marines  4 

civilians  4 

generic  for  ail  services  4 

annual  days  4 

pictures/signatures  of  top  officials  3 

women  in  rniitary  roles  3 

soldiers,  active  2 

equipment,  hardware  2 

recruiting  1 


Naval  equipment  1 

medical  topics  1 

commissary  1 

people  1 

safety  1 

Seabees  1 

reservists  1 

combat  JL 

Total  65 


ffl-C-3 


Presentation: 

need  smaller  pieces 

provide  art  to  accompany  specific  stories 

provide  art  without  dates 

provide  art  without  color  added 

provide  overseas  art  to  CONUS 

seasonal/people  art  are  dated- 
hair,  clothing 

quality  of  art  is  poor 

need  line  art  clearer,  sharper 

need  more  1/2  tones 

provide  series  artwork,  themes 
within  a  pack 

provide  more  specialized  booklets 

need  camera-ready  artwork 

use  more  current  graphics 

use  AP  stylebook  for  standardizations 


Total 


20 


Content:  Need  more  of  the  following 
Line  art  (general) 

Line  art  (specific): 

workers  in  office  and  industrial  settings 
all  rank  insignia 
older  equipment 
equipment,  aircraft 
computers 
Total 


7 

1 

1 

1 

1 

-1 

12 


Clip  art  (general)  4 

Cartoons  (general)  4 

Cartoons  (specific): 

Coastguard  1 

Navy  1 

ship  duty  1 

Total  7 


ffl-C-4 


Usage: 

use  art  in  broadcast  media  2 

can!  reproduce  photos  and  1/2  tones  2 
often  use  graphics  1 

sole  source  of  art  1 

rarely  use  art  1 

Total  7 

Grand  Total  for  Art  115 


COPY 

Address  the  following  topics: 

health  and  fitness,  sports  4 

guard  and  reserves  3 

family  issues  3 

defense  trends  (global)  2 

dependent  programs/services  2 

civilian  topics  2 

selling  techniques  1 

dealing  with  stress  1 

qualty  time  at  home  1 

fraud,  waste  and  abuse  1 

benefits  of  miltary  life  (travel)  1 

environmental  issues  1 

women  in  miStary  1 


change  of  command  ceremonies/  awards  1 
letters  from  DoD  secretary,  pres  1 

career  opportunities  1 

warriors  in  past  wars  1 

Champus  1 

Natl  defense  1 

work  1 

moving  1 

education  1 

retirement  1 


m-c-5 


saving  DoD  money 
energy 

support  missions 
no  smoking  stories 
personality  features 
military  counseling 
single  parenting  while  active  duty 
congressional  news 
Total 


1 

1 

1 

1 

1 

1 

1 


Style: 

shorten  articles 

make  stories  more  generic 

less  Jargon 

target  lower  ranks 

keep  speech  excerpts  short 

set  copy  right  justified 

provide  copy  for  specific  branches 

more  “hard"  news 

provide  more  real  interviews  with  brass 
Total 


9 

3 

2 

1 

1 

1 

1 

1 


20 


Usage: 

Only  use  small  amount  of  info  provided  3 
Need  more  copy  on  the  following: 


Coast  Guard  copy  5 

dvWan  news/issues  4 

Naval  reserve  news  1 

short,  filler  stories  1 

Air  Guard  information  _1 

Total  12 

Grand  Total  for  Copy  7  3 


ra-c-6 


DISTRIBUTION 


I 


Time: 

send  seasonal  artwork  earlier  1 0 

receive  time  sensitive  info  too  late  7 

make  more  time  sensitive  3 

Total  20 

Use  of  electronic  transmission: 

send  copy/art  on  disk  6 

use  Defense  Data  Network  2 

use  computer  bulletin  boards  for  copy  1 

would  like  to  receive  electronically  1 

Total  10 

Grand  Total  for  Distribution  30 


HINTS 

Suggestions: 

send  more  "between  the  lines"  and 

"production  tips"  5 

include  more  overseas  base  tips  3 

include  suggestions  from  other 

editors  in  P&AP  2 

provide  3  month  calendar  with 

important  dates  in  red  2 

require  AFPPS  writers  to  take  field  trips  1 

include  a  list  of  possible  story  ideas  1 

Total  14 

Provide  instructions  in  the  following  areas: 
how  to  use  cip  art  1 

using  Hne  art  1 

instructions  for  public  affairs  1 

Total  3 

Grand  Total  for  Hints  1 7 


ffl-C-7 


i 


OPINIONS 


Negative: 

art  is  poor  quality,  seldom  use 

rarely  use- not  enough  DoD  civilians 

information  is  often  dated 

too  Army  oriented 

articles  too  policy  oriented-boring 

remove 

cartoons  are  often  offensive 
many  spelling  errors-sloppy 
art  doesn't  reproduce  easily 
overseas  campaign  is  useless 
Total 

Positive: 

invaluable  resource 
often  file  artwork  for  future  use 
good  variety  of  information 
cartoons  by  Miller  are  good 
use  many  articles 
use  materials  often 
Total 


Neutral: 

radio  station-donl  use 
don't  receive 
Total 

Grand  total  for  Opinio  ns 


